Can't operate with big tables in mydb

Question

Hello!

I recently uploaded a fairly large table into mydb (~3.5e6 sources). And now I'm stuck because I can't operate with it in any way. I need to do a crossmatch with some Datalab tables (it doesn't work). I can't even list first 10 rows of it with a really simple sql query:

q = '''select * from mydb://table limit 10'''

convert(qc.query(sql=q))

I even can't drop it from mydb. The only thing that works is print(qc.mydb_list('table')).

Tank you in advance!

Answer 1

I was able to find a table in your mydb that was somehow in a locked state, i.e. there was a race condition in which one process was trying to drop the table while another accessed it, and since the mydb tables are kept in a separate database the conflict was between the two databases.  I removed the drop request and it appeared to clear the problem, but I now also see similar tables and activity in your account so I'm unsure whether there is still a problem.  I do not think this is related to the size of the table and can't seem to reproduce the problem either.

If the problem returns please post back with more information about what you were doing and the specific table name.  Hope this helps.