Amazon Athena is a server less interactive query service capable of querying data from Amazon Simple Storage Service (S3) using SQL. It is designed for short, interactive queries that are useful for data exploration. Athena enables you to run ad-hoc queries and quickly analyze data that is stored in S3 without ETL processes. Query results are stored in an S3 bucket and made available for analysis in BI tools. The data formats that Athena supports include CSV, JSON, Parquet, Avro, and ORC.
The following are the procedural steps to create an Athena connection:
- Download the corresponding JDBC Driver for Athena. Click any of the following links:
- In ETL Validator, mouse hover over the Add Data Source menu icon, under Generic, select Generic Connection.
- In the New Data Source screen, specify the following connection details:
- Name. Enter a connection name.
- Driver Class. Specify the driver class. The driver class looks like this: com.simba.athena.jdbc.Driver.
- JDBC URL. Specify the JDBC URL. Sample URL looks like this: jdbc:awsathena://User=<in encrypted form>
- Use Credentials. Select this checkbox to enter user credentials and schema details.
- Username. Enter the username of the database user to connect.
- Password. Enter the password of the database user.
- Schema Name. Enter the list of schemas to connect.
- Connection Timeout. Enter the time in seconds before which the ETL Server will need to establish the connection.
- Click Test to check whether the details entered are correct and connection is established successfully.
- Click Save. The connection is created.
- Place the driver class for Athena data source in the <install_directory>\app\Datagaps\ETLValidator\Server\apache-tomcat\webapps\ETLValidatorServer\WEB-INF\lib folder. If you have a ETL Validator version 3.4.9 SP2 or higher, place the driver class in the <install_directory>\app\Datagaps\ETLValidator\Server\apache-tomcat\bin\lib_dg folder.
- Restart the service for Tomcat Application Server (for default Tomcat, restart Datagaps ETL Validator Server.