-
Notifications
You must be signed in to change notification settings - Fork 102
Consider making pandas an optional dependency #489
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Comments
Adding to this - the size of pandas makes it really hard to run this in e.g. an AWS Lambda environment where total deployment package size is limited. |
gs11
pushed a commit
to gs11/databricks-sql-python
that referenced
this issue
Mar 24, 2025
gs11
pushed a commit
to gs11/databricks-sql-python
that referenced
this issue
Mar 24, 2025
Signed-off-by: Gustav Sinder <[email protected]>
gs11
pushed a commit
to gs11/databricks-sql-python
that referenced
this issue
Mar 24, 2025
Signed-off-by: Gustav Sinder <[email protected]>
gs11
pushed a commit
to gs11/databricks-sql-python
that referenced
this issue
Mar 24, 2025
Signed-off-by: Gustav Sinder <[email protected]>
gs11
added a commit
to gs11/databricks-sql-python
that referenced
this issue
Mar 24, 2025
Signed-off-by: Gustav Sinder <[email protected]>
gs11
added a commit
to gs11/databricks-sql-python
that referenced
this issue
Mar 24, 2025
Signed-off-by: Gustav Sinder <[email protected]>
gs11
added a commit
to gs11/databricks-sql-python
that referenced
this issue
Mar 24, 2025
Signed-off-by: Gustav Sinder <[email protected]>
gs11
added a commit
to gs11/databricks-sql-python
that referenced
this issue
Mar 24, 2025
Signed-off-by: Gustav Sinder <[email protected]>
gs11
added a commit
to gs11/databricks-sql-python
that referenced
this issue
Mar 24, 2025
Signed-off-by: Gustav Sinder <[email protected]>
gs11
added a commit
to gs11/databricks-sql-python
that referenced
this issue
Mar 24, 2025
Signed-off-by: Gustav Sinder <[email protected]>
gs11
added a commit
to gs11/databricks-sql-python
that referenced
this issue
Mar 24, 2025
Signed-off-by: Gustav Sinder <[email protected]>
gs11
added a commit
to gs11/databricks-sql-python
that referenced
this issue
Mar 24, 2025
Signed-off-by: Gustav Sinder <[email protected]>
8 tasks
gs11
added a commit
to gs11/databricks-sql-python
that referenced
this issue
Apr 18, 2025
Signed-off-by: Gustav Sinder <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Description
Currently pandas is a hard requirement for the library, however not necessarily used.
By delaying pandas import in
src/databricks/sql/client.py
from the top of the file to_convert_arrow_table
method after theif self.connection.disable_pandas is True:
condition it would be possible to make pandas an optional dependency.I was able to run all the tests with this change flawlessly, as well as uninstalling pandas and then run the following:
without any issue
The text was updated successfully, but these errors were encountered: