X-CGP-ClamAV-Result: CLEAN X-VirusScanner: Niversoft's CGPClamav Helper v1.22.2a (ClamAV engine v0.102.2) X-Junk-Score: 0 [] X-KAS-Score: 0 [] From: "Don Lindsay" Received: from st43p00im-ztfb10061701.me.com ([17.58.63.172] verified) by post.selbstdenker.com (CommuniGate Pro SMTP 6.3.3) with ESMTPS id 25484247 for webobjects-dev@wocommunity.org; Mon, 01 Mar 2021 02:35:05 +0100 Received-SPF: pass receiver=post.selbstdenker.com; client-ip=17.58.63.172; envelope-from=pccdonl@icloud.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=icloud.com; s=1a1hai; t=1614562483; bh=Uag3SvnwiLbSqSZFRdqYeyeNB46AJlzT9h6VCQ4+DdY=; h=From:Content-Type:Mime-Version:Subject:Date:To:Message-Id; b=mIPZHPzwNjEvQrsQbJ6i40tQRdqGUcTPFcfevssd4Zy2lKprynOdBl59jJjRADK45 olXrdSVauFpKb21rvKJUxNHtK/U7//XFyZgfS45hjSu/h9ZCAq434NXgg9MbL6dq4L Mfl9DZ/xqaFRRRm/I3hA9bkFsrLKQQwCYWJGvVdWCzlCNnBA8jdXY5Iy8ytDd8T8ig ++CC0mf8DyStVorKSGZ56+RkFCeVLXdNBXfI9Cx03j2T3jsUucjDrcrLHUxE4lj+ql sHHB9CCwNg1RCP4id+CXz997nnhfbsa5nqkgC0GGunY5nRTT/Dx1FPnm+91jIlbTKL c8mU+ODQkMwoA== Received: from [192.168.1.110] (ip-69-10-101-174.midstate.ip.cablemo.net [69.10.101.174]) by st43p00im-ztfb10061701.me.com (Postfix) with ESMTPSA id 8BD87AC03DD for ; Mon, 1 Mar 2021 01:34:43 +0000 (UTC) Content-Type: multipart/alternative; boundary="Apple-Mail=_B469A98A-F628-4B12-8B6B-772FB52BDAE6" Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: [WO-DEV] Athena JDBC Date: Sun, 28 Feb 2021 19:34:42 -0600 References: To: WebObjects & WOnder Development In-Reply-To: Message-Id: <2F01C23D-D4DE-4079-8A5D-C6DB6773F340@icloud.com> X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Proofpoint-Virus-Version: =?UTF-8?Q?vendor=3Dfsecure_engine=3D1.1.170-22c6f66c430a71ce266a39bfe25bc?= =?UTF-8?Q?2903e8d5c8f:6.0.369,18.0.761,17.0.607.475.0000000_definitions?= =?UTF-8?Q?=3D2021-02-28=5F12:2021-02-24=5F02,2021-02-28=5F12,2020-04-07?= =?UTF-8?Q?=5F01_signatures=3D0?= X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 malwarescore=0 spamscore=0 adultscore=0 clxscore=1015 suspectscore=0 mlxlogscore=999 mlxscore=0 bulkscore=0 phishscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2009150000 definitions=main-2103010010 --Apple-Mail=_B469A98A-F628-4B12-8B6B-772FB52BDAE6 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Thanks Ramsey, I will create y own plugin for Athena and put in the = appropriate queries to get metadata. Thanks Don > On Feb 28, 2021, at 19:06, Ramsey Gurley = wrote: >=20 > Looks like that's happening in = com.webobjects.jdbcadaptor.JDBCChannel.describeTableNames(). It appears = you can provide that sql statement in your JDBCPlugin subclass using = sqlStatementForGettingTableNames(). If that returns a non-null string, = it will attempt to use that first before going to DatabaseMetaData. >=20 >> On Mar 1, 2021, at 6:45 AM, Don Lindsay = > = wrote: >>=20 >> I am not using the MYSQL plugin on Athena JDBC connections: >>=20 >> 1. I have data in an Athena instance in AWS. =20 >> 2. I am able to connect to the database but not retrieve any = Database Metadata of any kind in a webobjects application and EOModeler. = =20 >> 3. I have tried with Intellij DataGrip, which is a JDBC query IDE, = and that application is able to get all metadata (databases, schemas, = tables and views). =20 >>=20 >> Based on the above bullets, I am describing that no metadata is = returned in EOModeler , or for that matter calling JDBC connection = getMetaData method. >>=20 >> Conclusion: >>=20 >> Whatever queries the JDBC connector is using to pull metadata from = the connection are not working for the Athena AWS JDBC driver. >>=20 >> What I have looked at to resolve the issue: >>=20 >> The query that is used with the Athena JDBC driver is =E2=80=9CSHOW = TABLES IN =E2=80=9D to retrieve table names from the JDBC = connection. >>=20 >> My thought process: >>=20 >> Maybe a plugin can change the queries that are used to discover = tables for EOF. =20 >>=20 >> My Action: >> Go into project wonder and look at some code there to see if anything = like this has been done in the Wonder project >> Code that was found in Wonder that made the most sense to look at was = plugins >> Opened the MySql plugin to see if there was any indication in there = where I could change the schema and table discovery methods for EOF so = it discovers the metadata. >> Result: >>=20 >> I have not found a way, or any code in Wonder that already does it, = to modify the metadata discovery for the Athena JDBC driver. My = question to the list is: >>=20 >> 1. Is there a way to modify the way EOF discovers metadata for a = specific type of database >> 2. If there is what class and methods would I need to implement, = extend, override to be able to get the metadata into EOF for the Athena = AWS database. >>=20 >>=20 >> Don >>=20 >> I went into project wonder and looked at the MySQL plugin to see if = there is a way to change the queries that are used to get database = metadata in a plugin for EOF. >>>=20 >>>>=20 >>>> Is anyone else using Athena JDBC driver? What was your experience = if you are. >>>>=20 >>>> Any pointers on how to modify how the JDBC EOF framework discovers = metadata. >>>>=20 >>>> For Athena the query is Show TABLES IN >>>>=20 >>>> Any help that anyone can provide would be great. >>=20 >>> On Feb 28, 2021, at 14:06, Ray Kiddy > wrote: >>>=20 >>> I am not sure that I understand your question. >>>=20 >>> If you want to connect to another kind of database and the MySQL = plugin is not doing it, the obvious answer would be to write another = plugin, one specifically for Athena. Does anyone have a plugin for = Athena? >>>=20 >>> Is Athena supposed to be API compatible with MySQL? Glancing at some = documentation, I am not seeing that it is or is supposed to be. Does the = MySQL plugin "almost" work? If so, perhaps the MySQL plugin could be = re-used and extended for Athena. >>>=20 >>> As to "how to modify how the JDBC EOF framework discovers metadata", = the answer would be to use the methods available when writing a new = plugin to get the information and return the information EOF needs. >>>=20 >>> Given this, are you asking how to write a plugin for Athena, or are = you asking if one already exists, or if someone else would write it? >>>=20 >>> cheers - ray >>>=20 >>> On 2/27/21 7:20 PM, Don Lindsay wrote: >>>> Hello; >>>>=20 >>>> I have data in an Athena instance in AWS. I am able to connect to = the database but not retrieve any Database Metadata of any kind. I = have tried with IntellijDataGrip and that application is able to get all = metadata (databases, schemas, tables and views. I went into project = wonder and looked at the MySQL plugin to see if there is a way to change = the queries that are used to get database metadata in a plugin for EOF. >>>>=20 >>>> Is anyone else using Athena JDBC driver? What was your experience = if you are. >>>>=20 >>>> Any pointers on how to modify how the JDBC EOF framework discovers = metadata. >>>>=20 >>>> For Athena the query is Show TABLES IN >>>>=20 >>>> Any help that anyone can provide would be great. >>>>=20 >>>> Thanks >>>>=20 >>>> Don >>>=20 >>> ############################################################# >>> This message is sent to you because you are subscribed to >>> the mailing list >. >>> To unsubscribe, E-mail to: > >>> To switch to the DIGEST mode, E-mail to = > >>> To switch to the INDEX mode, E-mail to = > >>> Send administrative queries to = > >>>=20 >>=20 >=20 > Confidentiality Notice: This email, including all attachments and = replies thereto, are covered by the Electronic Communications Privacy = Act, 18 U.S.C. Sections 2510-2521 and are legally privileged. This = information is confidential, and intended only for the use of the = individuals or entities named above. If you are not the intended = recipient, you are hereby notified that any disclosure, copying, = distribution or the taking of any action in reliance on the contents of = this transmitted information is strictly prohibited. Please notify us if = you have received this transmission in error. Thank you. --Apple-Mail=_B469A98A-F628-4B12-8B6B-772FB52BDAE6 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 Thanks Ramsey, I will create y own plugin for Athena and put = in the appropriate queries to get metadata.

Thanks

Don

On Feb = 28, 2021, at 19:06, Ramsey Gurley <webobjects-dev@wocommunity.org> wrote:

Looks like that's happening in = com.webobjects.jdbcadaptor.JDBCChannel.describeTableNames(). It appears = you can provide that sql statement in your JDBCPlugin subclass = using sqlStatementForGettingTableNames(). If that returns a = non-null string, it will attempt to use that first before going to DatabaseMetaData.

On Mar 1, 2021, at 6:45 AM, Don Lindsay <webobjects-dev@wocommunity.org> wrote:

I am not using the MYSQL = plugin on Athena JDBC connections:

1.  I have data in an Athena instance in AWS. =  
2.  I am able to connect to the database but not = retrieve any Database Metadata of any kind in a webobjects application = and EOModeler.    
3.  I have tried with Intellij DataGrip, which is a = JDBC query IDE, and that application is able to get all metadata = (databases, schemas, tables and views).  

Based on the above bullets, I am describing that no = metadata is returned in EOModeler , or for that matter calling JDBC = connection getMetaData method.

Conclusion:

Whatever queries the JDBC connector is using to pull = metadata from the connection are not working for the Athena AWS JDBC = driver.

What I have looked at to = resolve the issue:

The query that is used with the Athena JDBC driver is = =E2=80=9CSHOW TABLES IN <DATABASE>=E2=80=9D to retrieve table = names from the JDBC connection.

My thought = process:

Maybe a plugin can change the queries that are used to = discover tables for EOF.  

My Action:
  1. Go into project wonder and look at some code there to see = if anything like this has been done in the Wonder project
  2. Code that was found in Wonder that made the most sense to = look at was plugins
  3. Opened the MySql plugin to see if = there was any indication in there where I could change the schema and = table discovery methods for EOF so it discovers the metadata.
Result:

I have not found a way, or any code in Wonder that = already does it, to modify the metadata discovery for the Athena JDBC = driver.  My question to the list is:

1.  Is there a way to modify the way EOF discovers = metadata for a specific type of database
2.  If there is what class and methods would I need = to implement, extend, override to be able to get the metadata into EOF = for the Athena AWS database.


Don

I went into project wonder and looked at the MySQL = plugin to see if there is a way to change the queries that are used to = get database metadata in a plugin for EOF.

Is anyone else using Athena JDBC driver?  What was your experience = if you are.

Any pointers on how to modify how the JDBC EOF framework discovers = metadata.

For Athena the query is Show TABLES IN <DATABASE>

Any help that anyone can provide would be great.

On Feb 28, 2021, at 14:06, Ray Kiddy <webobjects-dev@wocommunity.org> wrote:

I am not sure that I understand your question.

If you want to connect to another kind of database and the MySQL plugin = is not doing it, the obvious answer would be to write another plugin, = one specifically for Athena. Does anyone have a plugin for Athena?

Is Athena supposed to be API compatible with MySQL? Glancing at some = documentation, I am not seeing that it is or is supposed to be. Does the = MySQL plugin "almost" work? If so, perhaps the MySQL plugin could be = re-used and extended for Athena.

As to "how to modify how the JDBC EOF framework discovers metadata", the = answer would be to use the methods available when writing a new plugin = to get the information and return the information EOF needs.

Given this, are you asking how to write a plugin for Athena, or are you = asking if one already exists, or if someone else would write it?

cheers - ray

On 2/27/21 7:20 PM, Don Lindsay wrote:
Hello;

I have data in an Athena instance in AWS.  I am able to connect to = the database but not retrieve any Database Metadata of any kind. =    I have tried with IntellijDataGrip and that = application is able to get all metadata (databases, schemas, tables and = views.  I went into project wonder and looked at the MySQL plugin to see = if there is a way to change the queries that are used to get database = metadata in a plugin for EOF.

Is anyone else using Athena JDBC driver?  What was your experience = if you are.

Any pointers on how to modify how the JDBC EOF framework discovers = metadata.

For Athena the query is Show TABLES IN <DATABASE>

Any help that anyone can provide would be great.

Thanks

Don

#############################################################
This message is sent to you because you are subscribed to
the mailing list <webobjects-dev@wocommunity.org>.
To unsubscribe, E-mail to: <webobjects-dev-off@wocommunity.org>
To switch to the DIGEST mode, E-mail to <webobjects-dev-digest@wocommunity.org>
To switch to the INDEX mode, E-mail to <webobjects-dev-index@wocommunity.org>
Send administrative queries to  <webobjects-dev-request@wocommunity.org>



Confidentiality Notice: This email, = including all attachments and replies thereto, are covered by the = Electronic Communications Privacy Act, 18 U.S.C. Sections 2510-2521 and = are legally privileged. This information is confidential, and intended = only for the use of the individuals or entities named above. If you are not = the intended recipient, you are hereby notified that any disclosure, = copying, distribution or the taking of any action in reliance on the = contents of this transmitted information is strictly prohibited. Please notify us if you have received this transmission in = error. Thank you.

= --Apple-Mail=_B469A98A-F628-4B12-8B6B-772FB52BDAE6--