ipython-sql icon indicating copy to clipboard operation
ipython-sql copied to clipboard

Memory Error with any functionality

Open ScriptPup opened this issue 4 years ago • 0 comments

Hi! This seems like a really awesome and useful magic pack, but I'm getting a "Memory Error" even going the most simple tests.

Version info: python 3.7.3 ipython 7.20.0 (originally I had 7.10.2, but I upgraded as part of troubleshooting) ipython-sql 0.4.0

cell 1

%load_ext sql
%sql mssql+pyodbc://GRONKSMASH.AMER.DELL.COM/SDS_COMMERCIAL_GSA?trusted_connection=yes&driver=ODBC+Driver+13+for+SQL+Server

cell 2

%%sql 
a <<
SELECT 1 FROM table

Cell 3

a.DataFrame()

Results in

---------------------------------------------------------------------------
MemoryError                               Traceback (most recent call last)
<ipython-input-3-c5a46a0b5683> in <module>
----> 1 b.DataFrame()

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\sql\run.py in DataFrame(self)
    172         import pandas as pd
    173 
--> 174         frame = pd.DataFrame(self, columns=(self and self.keys) or [])
    175         return frame
    176 

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\frame.py in __init__(self, data, index, columns, dtype, copy)
    448                     if is_named_tuple(data[0]) and columns is None:
    449                         columns = data[0]._fields
--> 450                     arrays, columns = to_arrays(data, columns, dtype=dtype)
    451                     columns = ensure_index(columns)
    452 

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\internals\construction.py in to_arrays(data, columns, coerce_float, dtype)
    486         # last ditch effort
    487         data = [tuple(x) for x in data]
--> 488         return _list_to_arrays(data, columns, coerce_float=coerce_float, dtype=dtype)
    489 
    490 

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\internals\construction.py in _list_to_arrays(data, columns, coerce_float, dtype)
    498     try:
    499         result = _convert_object_array(
--> 500             content, columns, dtype=dtype, coerce_float=coerce_float
    501         )
    502     except AssertionError as e:

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\internals\construction.py in _convert_object_array(content, columns, coerce_float, dtype)
    591         return arr
    592 
--> 593     arrays = [convert(arr) for arr in content]
    594 
    595     return arrays, columns

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\internals\construction.py in <listcomp>(.0)
    591         return arr
    592 
--> 593     arrays = [convert(arr) for arr in content]
    594 
    595     return arrays, columns

C:\Users\scriptpup\AppData\Local\Programs\Python\Python37-32\lib\site-packages\pandas\core\internals\construction.py in convert(arr)
    587     def convert(arr):
    588         if dtype != object and dtype != np.object:
--> 589             arr = lib.maybe_convert_objects(arr, try_float=coerce_float)
    590             arr = maybe_cast_to_datetime(arr, dtype)
    591         return arr

pandas/_libs/lib.pyx in pandas._libs.lib.maybe_convert_objects()

MemoryError: Unable to allocate array with shape (10737222,) and data type complex128

I tried running inline commands as well but that produces the same error.

ScriptPup avatar Feb 02 '21 21:02 ScriptPup