question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Add support for Hive/Impala

See original GitHub issue

It would be really nice for Caravel to have support for Hive/Impala. There is a nice package called Impyla that provides a SQLAlchemy interface to Hive and Impala.

I am testing it out with Caravel, seems to be working so far with Hive. I can connect to my Hive database, there is a problem where SQLAlchemy tries to run a select version() as the first query, as this is not a valid Hive function, it causes an immediate failure. Once I resolve this I will open a pull request.

Issue Analytics

  • State:closed
  • Created 7 years ago
  • Reactions:6
  • Comments:14 (6 by maintainers)

github_iconTop GitHub Comments

6reactions
evinhascommented, Mar 16, 2017

I added an extra in the Superset “create database connection” for passing some connection arguments:

{
    "metadata_params": {},
    "engine_params": {
		"connect_args": {
		"auth_mechanism": "GSSAPI",
		"user" : "put_your_user_here",
		"password" : "None" }
}
}

So I introduced a connection URL as following one:

impala://impala_host:21050/impala_database

And it worked

Note: I had run a kinit before to connect.

1reaction
joshwalterscommented, Apr 13, 2016

Raised a pull request to fix this issue with Impala here: https://github.com/cloudera/impyla/pull/191

I have tested the Impyla fix, and verified that I now have a working Hive/Impala connection in Caravel. Once the Impyla fix is in, I will make a pull request against Caravel to add it.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Tutorial: Using Impala, Hive and Hue with Virtual Private ...
In a Virtural Private Cluster environment, Hue and the impala-shell can be used to setup databases, tables, insert and retrieve data using ...
Read more >
Add support for Hive/Impala · Issue #339 · apache/superset
I am testing it out with Caravel, seems to be working so far with Hive. I can connect to my Hive database, there...
Read more >
Apache Impala support (with Hive Metastore)
Add new connection ... To connect to Hive Metastore and create new documentation by clicking Add documentation and choosing Database connection.
Read more >
The Relationship Between Impala and Hive and its ...
Impala and Hive are both data query tools built on Hadoop, each with different focus on adaptability. From the perspective of client use, ......
Read more >
SQL Differences Between Impala and Hive
Impala supports high-performance UDFs written in C++, as well as reusing some Java-based Hive UDFs. Impala supports scalar UDFs and user-defined aggregate ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found