X-CGP-ClamAV-Result: CLEAN X-VirusScanner: Niversoft's CGPClamav Helper v1.22.2a (ClamAV engine v0.102.2) X-Junk-Score: 0 [] X-KAS-Score: 0 [] From: "Don Lindsay" Received: from st43p00im-ztfb10063301.me.com ([17.58.63.179] verified) by post.selbstdenker.com (CommuniGate Pro SMTP 6.3.3) with ESMTPS id 25483577 for webobjects-dev@wocommunity.org; Sun, 28 Feb 2021 22:46:04 +0100 Received-SPF: pass receiver=post.selbstdenker.com; client-ip=17.58.63.179; envelope-from=pccdonl@icloud.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=icloud.com; s=1a1hai; t=1614548743; bh=BFwDodSNlLQUVxuaVvZRLPSTuxaZkPq3C99jvJngiDw=; h=From:Content-Type:Mime-Version:Subject:Date:To:Message-Id; b=lq/oI1sd08Ha4xavUu4sdxUhpevS30WRVS+O2/gH+iwEQD5yQm8yL0v+agbVS/Q9P UiYaNlA9HDtee4B8EJmuVJwVdvx7sKnE+5LUy78Bipp8fFnuO/wRTCtIxjo9mFtTgl YSh+lQfoLhFvrrKqvoQy2Byhr0X4z4RZJdnF6GJtMCNaY1HO196ULLYVnWycDgnN+o Scu0bwF8Q5oZjPiMlkdf/i8iZhdqCpMPmPanIVm9Pe7YOBe4t7JNXXDgr1rvhQGlSZ 7/reNg/Gl+/YTS2EWxqjcZHazY05a8VDK4ttoWRJbojUU/gqFJk3JaZUCUWlHZ0F7+ q3jVOAwjtBMcQ== Received: from [192.168.1.110] (ip-69-10-101-174.midstate.ip.cablemo.net [69.10.101.174]) by st43p00im-ztfb10063301.me.com (Postfix) with ESMTPSA id 2F4B2A40500 for ; Sun, 28 Feb 2021 21:45:43 +0000 (UTC) Content-Type: multipart/alternative; boundary="Apple-Mail=_70D07C37-3125-4C89-BEC1-EBD1769999E3" Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: [WO-DEV] Athena JDBC Date: Sun, 28 Feb 2021 15:45:42 -0600 References: To: WebObjects & WOnder Development In-Reply-To: Message-Id: X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.369,18.0.761 definitions=2021-02-28_10:2021-02-26,2021-02-28 signatures=0 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 suspectscore=0 malwarescore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 mlxscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-2006250000 definitions=main-2102280185 --Apple-Mail=_70D07C37-3125-4C89-BEC1-EBD1769999E3 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 I am not using the MYSQL plugin on Athena JDBC connections: 1. I have data in an Athena instance in AWS. =20 2. I am able to connect to the database but not retrieve any Database = Metadata of any kind in a webobjects application and EOModeler. =20 3. I have tried with Intellij DataGrip, which is a JDBC query IDE, and = that application is able to get all metadata (databases, schemas, tables = and views). =20 Based on the above bullets, I am describing that no metadata is returned = in EOModeler , or for that matter calling JDBC connection getMetaData = method. Conclusion: Whatever queries the JDBC connector is using to pull metadata from the = connection are not working for the Athena AWS JDBC driver. What I have looked at to resolve the issue: The query that is used with the Athena JDBC driver is =E2=80=9CSHOW = TABLES IN =E2=80=9D to retrieve table names from the JDBC = connection. My thought process: Maybe a plugin can change the queries that are used to discover tables = for EOF. =20 My Action: Go into project wonder and look at some code there to see if anything = like this has been done in the Wonder project Code that was found in Wonder that made the most sense to look at was = plugins Opened the MySql plugin to see if there was any indication in there = where I could change the schema and table discovery methods for EOF so = it discovers the metadata. Result: I have not found a way, or any code in Wonder that already does it, to = modify the metadata discovery for the Athena JDBC driver. My question = to the list is: 1. Is there a way to modify the way EOF discovers metadata for a = specific type of database 2. If there is what class and methods would I need to implement, = extend, override to be able to get the metadata into EOF for the Athena = AWS database. Don I went into project wonder and looked at the MySQL plugin to see if = there is a way to change the queries that are used to get database = metadata in a plugin for EOF. >=20 >>=20 >> Is anyone else using Athena JDBC driver? What was your experience if = you are. >>=20 >> Any pointers on how to modify how the JDBC EOF framework discovers = metadata. >>=20 >> For Athena the query is Show TABLES IN >>=20 >> Any help that anyone can provide would be great. > On Feb 28, 2021, at 14:06, Ray Kiddy = wrote: >=20 > I am not sure that I understand your question. >=20 > If you want to connect to another kind of database and the MySQL = plugin is not doing it, the obvious answer would be to write another = plugin, one specifically for Athena. Does anyone have a plugin for = Athena? >=20 > Is Athena supposed to be API compatible with MySQL? Glancing at some = documentation, I am not seeing that it is or is supposed to be. Does the = MySQL plugin "almost" work? If so, perhaps the MySQL plugin could be = re-used and extended for Athena. >=20 > As to "how to modify how the JDBC EOF framework discovers metadata", = the answer would be to use the methods available when writing a new = plugin to get the information and return the information EOF needs. >=20 > Given this, are you asking how to write a plugin for Athena, or are = you asking if one already exists, or if someone else would write it? >=20 > cheers - ray >=20 > On 2/27/21 7:20 PM, Don Lindsay wrote: >> Hello; >>=20 >> I have data in an Athena instance in AWS. I am able to connect to = the database but not retrieve any Database Metadata of any kind. I = have tried with IntellijDataGrip and that application is able to get all = metadata (databases, schemas, tables and views. I went into project = wonder and looked at the MySQL plugin to see if there is a way to change = the queries that are used to get database metadata in a plugin for EOF. >>=20 >> Is anyone else using Athena JDBC driver? What was your experience if = you are. >>=20 >> Any pointers on how to modify how the JDBC EOF framework discovers = metadata. >>=20 >> For Athena the query is Show TABLES IN >>=20 >> Any help that anyone can provide would be great. >>=20 >> Thanks >>=20 >> Don >=20 > ############################################################# > This message is sent to you because you are subscribed to > the mailing list . > To unsubscribe, E-mail to: > To switch to the DIGEST mode, E-mail to = > To switch to the INDEX mode, E-mail to = > Send administrative queries to = >=20 --Apple-Mail=_70D07C37-3125-4C89-BEC1-EBD1769999E3 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 I am not using the MYSQL plugin = on Athena JDBC connections:

1.  I have data in = an Athena instance in AWS.  
2.  I am = able to connect to the database but not retrieve any Database Metadata = of any kind in a webobjects application and EOModeler. =    
3.  I have tried with = Intellij DataGrip, which is a JDBC query IDE, and that application is = able to get all metadata (databases, schemas, tables and views). =  

Based = on the above bullets, I am describing that no metadata is returned in = EOModeler , or for that matter calling JDBC connection getMetaData = method.

Conclusion:

Whatever queries the JDBC connector is = using to pull metadata from the connection are not working for the = Athena AWS JDBC driver.

What I have looked at to resolve = the issue:

The query that is used with the Athena JDBC driver is =E2=80=9C= SHOW TABLES IN <DATABASE>=E2=80=9D to retrieve table names from = the JDBC connection.

My thought = process:

Maybe a plugin can change the queries that are used to = discover tables for EOF.  

My = Action:
  1. Go = into project wonder and look at some code there to see if anything like = this has been done in the Wonder project
  2. Code that = was found in Wonder that made the most sense to look at was = plugins
  3. Opened the MySql plugin to see if there was = any indication in there where I could change the schema and table = discovery methods for EOF so it discovers the metadata.
Result:

I have not found a way, = or any code in Wonder that already does it, to modify the metadata = discovery for the Athena JDBC driver.  My question to the list = is:

1. =  Is there a way to modify the way EOF discovers metadata for a = specific type of database
2.  If there is what = class and methods would I need to implement, extend, override to be able = to get the metadata into EOF for the Athena AWS database.


Don

I= went into project wonder and looked at the MySQL plugin to see if there = is a way to change the queries that are used to get database metadata in = a plugin for EOF.

Is anyone else using Athena JDBC = driver?  What was your experience if you are.

Any pointers on how to modify how the JDBC EOF framework = discovers metadata.

For Athena the query is = Show TABLES IN <DATABASE>

Any help = that anyone can provide would be great.

On Feb = 28, 2021, at 14:06, Ray Kiddy <webobjects-dev@wocommunity.org> wrote:

I am = not sure that I understand your question.

If = you want to connect to another kind of database and the MySQL plugin is = not doing it, the obvious answer would be to write another plugin, one = specifically for Athena. Does anyone have a plugin for Athena?

Is Athena supposed to be API compatible with = MySQL? Glancing at some documentation, I am not seeing that it is or is = supposed to be. Does the MySQL plugin "almost" work? If so, perhaps the = MySQL plugin could be re-used and extended for Athena.

As to "how to modify how the JDBC EOF framework discovers = metadata", the answer would be to use the methods available when writing = a new plugin to get the information and return the information EOF = needs.

Given this, are you asking how to = write a plugin for Athena, or are you asking if one already exists, or = if someone else would write it?

cheers - = ray

On 2/27/21 7:20 PM, Don Lindsay = wrote:
Hello;

I have data in an Athena instance in AWS. =  I am able to connect to the database but not retrieve any Database = Metadata of any kind.    I have tried with = IntellijDataGrip and that application is able to get all metadata = (databases, schemas, tables and views.  I went into project wonder = and looked at the MySQL plugin to see if there is a way to change the = queries that are used to get database metadata in a plugin for EOF.

Is anyone else using Athena JDBC driver? =  What was your experience if you are.

Any pointers on how to modify how the JDBC EOF framework = discovers metadata.

For Athena the query is = Show TABLES IN <DATABASE>

Any help = that anyone can provide would be great.

Thanks

Don

#############################################################This message is sent to you because you are subscribed = to
the mailing list <webobjects-dev@wocommunity.org>.
To = unsubscribe, E-mail to: <webobjects-dev-off@wocommunity.org>
To = switch to the DIGEST mode, E-mail to <webobjects-dev-digest@wocommunity.org>
To = switch to the INDEX mode, E-mail to <webobjects-dev-index@wocommunity.org>
Send= administrative queries to  <webobjects-dev-request@wocommunity.org>


= --Apple-Mail=_70D07C37-3125-4C89-BEC1-EBD1769999E3--