tables icon indicating copy to clipboard operation
tables copied to clipboard

No data of existing tables after update

Open Jednadvacet opened this issue 3 months ago • 31 comments

Steps to reproduce

  1. Update Tables to 0.7.0. (NC 28.0.4, 29.0.0.)
  2. Tables -> Select a table
  3. Cry

Expected behavior

Table data views should be available.

Actual behavior

After Tables app update to 0.7.0. no table data to display. 0, none.

Log: InternalError, No column found to build filter with for id -2 An internal error or exception occurred: No column found to build filter with for id -2

Help, please.

Tables app version

0.7.0.

Browser

Edge

Client operating system

No response

Operating system

Ubuntu 20.04

Web server

Nginx

PHP engine version

PHP 8.1

Database

MariaDB

Additional info

No response

Jednadvacet avatar Apr 25 '24 09:04 Jednadvacet

We have the same problem. I opened a bug report at the same time. I think this can be merged

osm-frasch avatar Apr 25 '24 09:04 osm-frasch

Sure!

Jednadvacet avatar Apr 25 '24 09:04 Jednadvacet

Got the same issue there. I don't have access to the DB myself but do you know if the data is lost or is it just the app failing the DB request?

GoOz avatar Apr 25 '24 10:04 GoOz

Can you paste the full raw json content of the error message, however just from the message it looks like #998 and it looks like it is just failing to list the tables due to a somewhat strange view filter in place

juliushaertl avatar Apr 25 '24 11:04 juliushaertl

This is mine:

{"reqId":"7nwHGp5F7xMealyHHIVM","level":3,"time":"2024-04-25T09:34:34+00:00","remoteAddr":"213.250.193.178","user":"ondra","app":"tables","method":"GET","url":"/apps/tables/table","message":"No column found to build filter with for id -2","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/123.0.0.0 Safari/537.36 Edg/123.0.0.0","version":"29.0.0.19","exception":{"Exception":"OCA\Tables\Errors\InternalError","Message":"No column found to build filter with for id -2","Code":0,"Trace":[{"file":"/var/www/html/nextcloud/apps/tables/lib/Db/Row2Mapper.php","line":263,"function":"getFilter","class":"OCA\Tables\Db\Row2Mapper","type":"->"},{"file":"/var/www/html/nextcloud/apps/tables/lib/Db/Row2Mapper.php","line":241,"function":"getFilterGroups","class":"OCA\Tables\Db\Row2Mapper","type":"->"},{"file":"/var/www/html/nextcloud/apps/tables/lib/Db/Row2Mapper.php","line":143,"function":"addFilterToQuery","class":"OCA\Tables\Db\Row2Mapper","type":"->"},{"file":"/var/www/html/nextcloud/apps/tables/lib/Db/Row2Mapper.php","line":827,"function":"getWantedRowIds","class":"OCA\Tables\Db\Row2Mapper","type":"->"},{"file":"/var/www/html/nextcloud/apps/tables/lib/Service/RowService.php","line":535,"function":"countRowsForView","class":"OCA\Tables\Db\Row2Mapper","type":"->"},{"file":"/var/www/html/nextcloud/apps/tables/lib/Service/ViewService.php","line":413,"function":"getViewRowsCount","class":"OCA\Tables\Service\RowService","type":"->"},{"file":"/var/www/html/nextcloud/apps/tables/lib/Service/ViewService.php","line":90,"function":"enhanceView","class":"OCA\Tables\Service\ViewService","type":"->"},{"file":"/var/www/html/nextcloud/apps/tables/lib/Service/TableService.php","line":227,"function":"findAll","class":"OCA\Tables\Service\ViewService","type":"->"},{"file":"/var/www/html/nextcloud/apps/tables/lib/Service/TableService.php","line":149,"function":"enhanceTable","class":"OCA\Tables\Service\TableService","type":"->"},{"file":"/var/www/html/nextcloud/apps/tables/lib/Controller/TableController.php","line":39,"function":"findAll","class":"OCA\Tables\Service\TableService","type":"->"},{"file":"/var/www/html/nextcloud/apps/tables/lib/Controller/Errors.php","line":16,"function":"OCA\Tables\Controller\{closure}","class":"OCA\Tables\Controller\TableController","type":"->","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/html/nextcloud/apps/tables/lib/Controller/TableController.php","line":40,"function":"handleError","class":"OCA\Tables\Controller\TableController","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/AppFramework/Http/Dispatcher.php","line":232,"function":"index","class":"OCA\Tables\Controller\TableController","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/AppFramework/Http/Dispatcher.php","line":138,"function":"executeController","class":"OC\AppFramework\Http\Dispatcher","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/AppFramework/App.php","line":184,"function":"dispatch","class":"OC\AppFramework\Http\Dispatcher","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Route/Router.php","line":338,"function":"main","class":"OC\AppFramework\App","type":"::"},{"file":"/var/www/html/nextcloud/lib/base.php","line":1050,"function":"match","class":"OC\Route\Router","type":"->"},{"file":"/var/www/html/nextcloud/index.php","line":49,"function":"handleRequest","class":"OC","type":"::"}],"File":"/var/www/html/nextcloud/apps/tables/lib/Db/Row2Mapper.php","Line":276,"message":"No column found to build filter with for id -2","exception":[],"CustomMessage":"No column found to build filter with for id -2"},"id":"662a42782dffb"}

Jednadvacet avatar Apr 25 '24 11:04 Jednadvacet

Same issue here.

daCaPo avatar Apr 25 '24 12:04 daCaPo

same issue here any chance the data can be recovered? 😬

This is the log I got in nextcloud logging section:

Exception
Repair step 'OCA\Tables\Migration\NewDbStructureRepairStep' can't be instantiated: Could not resolve OCA\Tables\Db\RowMapper! Class "OCA\Tables\Db\RowMapper" does not exist
Exception thrown: Exception

JohannesTeichert avatar Apr 25 '24 14:04 JohannesTeichert

@JohannesTeichert from what I understood and what is said in #998 the data is indeed still there, so no loss.

GoOz avatar Apr 25 '24 14:04 GoOz

See my https://github.com/nextcloud/tables/issues/998#issuecomment-2077297212 (and maybe merge #988 and #999?)

daCaPo avatar Apr 25 '24 14:04 daCaPo

I updated my initial comment with the log from the Log viewer:

This is the log I got in nextcloud logging section:

Exception
Repair step 'OCA\Tables\Migration\NewDbStructureRepairStep' can't be instantiated: Could not resolve OCA\Tables\Db\RowMapper! Class "OCA\Tables\Db\RowMapper" does not exist
Exception thrown: Exception

are we having the same problem?

JohannesTeichert avatar Apr 25 '24 15:04 JohannesTeichert

All my rows from the table have gone (!!!) after update to 0.7.0. These are around 250 records. What to do to bring them back? Is it possible to downgrade?

UPD: This command fixed the issue:

occ tables:legacy:transfer:rows --all

ostasevych avatar Apr 25 '24 15:04 ostasevych

Yes, we are - on my 28.0.4 instance. And PHP error: Undefined array key "manageTable" at /var/www/html/nextcloud/cloud.live/custom_apps/tables/lib/Service/ViewService.php#419. Probably for every table view.

But: On my second NC instance 29.0.0. there are another messages: Warning: Try to set no user in context, but request is not allowed. Warning: An internal error or exception occurred: No column found to build filter with for id -2 Error: InternalError No column found to build filter with for id -2

28.0.5 is Ubuntu php8.1 nginx posqgres 29.0.0. is Raspberry ubuntu, php8.1 nginx mariadb/mysql

čt 25. 4. 2024 v 17:24 odesílatel Johannes Teichert < @.***> napsal:

I updated my initial comment with the log from the Log viewer:

This is the log I got in nextcloud logging section:

Exception Repair step 'OCA\Tables\Migration\NewDbStructureRepairStep' can't be instantiated: Could not resolve OCA\Tables\Db\RowMapper! Class "OCA\Tables\Db\RowMapper" does not exist Exception thrown: Exception

are we having the same problem?

— Reply to this email directly, view it on GitHub https://github.com/nextcloud/tables/issues/999#issuecomment-2077569446, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASTVCR55IICYXIACWGSKL4TY7EN3RAVCNFSM6AAAAABGYQNDC6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANZXGU3DSNBUGY . You are receiving this because you authored the thread.Message ID: @.***>

Jednadvacet avatar Apr 25 '24 15:04 Jednadvacet

occ tables:legacy:transfer:rows --all

works perfectly

rakurtz avatar Apr 26 '24 08:04 rakurtz

All my rows from the table have gone (!!!) after update to 0.7.0. These are around 250 records. What to do to bring them back? Is it possible to downgrade?

UPD: This command fixed the issue:

occ tables:legacy:transfer:rows --all

Thank you so much 🥹

You saved a lot of work

Morethanevil avatar Apr 26 '24 20:04 Morethanevil

occ tables:legacy:transfer:rows --all

Sadly, this command did not solve the problem for me. Tables are still not displayed. Creating new tables also fails.

UPDATE: After restarting the server, the tables are accessible again. :-)

clatoverada avatar Apr 27 '24 13:04 clatoverada

After upgrading to 0.7.1 all my tables are gone. The occ command above did nothing.

I haven't found anything relevant in the log, only a couple of "Try to set no user in context, but request is not allowed" but one was from before the upgrade.

seindal avatar Apr 30 '24 06:04 seindal

Yes, Same here. After Update to 0.7.1 all tables are empty. using Nextcloud All in One on Debian

90madness avatar May 02 '24 09:05 90madness

occ tables:legacy:transfer:rows --all

worked for us, without restart, but .... some rows behave strangely... but no data was lost ! Anyway, that's a big thanks you for the tip and ... the app !

NL-CCMLM avatar May 03 '24 09:05 NL-CCMLM

The most strange thing observer by me is loosing date/time format. The rows are not sorted by date anymore :(

ostasevych avatar May 03 '24 09:05 ostasevych

Same issue here.

UPD: This command fixed the issue:

occ tables:legacy:transfer:rows --all

thank you!

b108 avatar May 05 '24 08:05 b108

All my rows from the table have gone (!!!) after update to 0.7.0. These are around 250 records. What to do to bring them back? Is it possible to downgrade?

UPD: This command fixed the issue:

occ tables:legacy:transfer:rows --all

Unfortunatelly i got "Look for tables Error while fetching tables. Will aboard." - anyone else wiht this problem?

Throntorus avatar May 05 '24 08:05 Throntorus

UPD: This command fixed the issue:

occ tables:legacy:transfer:rows --all

Thank you so much. I nearly nearly had a heart attack. This is worked for me on 7 tables with over 100 records between them.

Blackfire-dev avatar May 09 '24 16:05 Blackfire-dev

UPD: This command fixed the issue:

occ tables:legacy:transfer:rows --all

Thank you so much. I nearly nearly had a heart attack. This is worked for me on 7 tables with over 100 records between them.

Check data consistency. I have lost sorting by date, eg.

ostasevych avatar May 09 '24 16:05 ostasevych

UPD: This command fixed the issue:

occ tables:legacy:transfer:rows --all

Thank you so much. I nearly nearly had a heart attack. This is worked for me on 7 tables with over 100 records between them.

Check data consistency. I have lost sorting by date, eg.

I have just checked, fortunately I haven't had any loss or data or sorting options. Thank you for the heads up.

Blackfire-dev avatar May 12 '24 10:05 Blackfire-dev

How can I do this (occ tables:legacy:transfer:rows --all) when my NexCloud instance is on a hosted server? I tried OCCweb, but that crashes...

Taxicletter avatar May 13 '24 13:05 Taxicletter

How can I do this (occ tables:legacy:transfer:rows --all) when my NexCloud instance is on a hosted server? I tried OCCweb, but that crashes...

I use a PHP script like this:

<?php
$occ = "/usr/bin/env php -d memory_limit=512M [your path to Nextcloud here]/occ ";
# Use relative path to point to occ of your nextcloud installation and append the occ-command
$command = "/usr/bin/env php -d memory_limit=512M [your path to Nextcloud here]/occ tables:legacy:transfer:rows --all
";
?>
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8" />
<title>Execute Nextcloud occ-command on shared hosting</title>
<style>body { font-family: sans-serif; }</style>
</head>
<body>
<?php echo "<h1>Command</h1><p>" . htmlspecialchars($command) . "</p><h1>Result</h1><p>" . htmlspecialchars(exec($command)) . "</p>"; ?>
</body>
</html>

(Credits go to https://www.ich-war-hier.de/2020/09/21/nextcloud-occ-kommando-auf-webhoster-ohne-ssh-ausfuehren/)

daCaPo avatar May 13 '24 16:05 daCaPo