liz/wikijs-fork
liz/wikijs-fork
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

fix: rebuilding tree error when the page number is large enough in sqlite (#2830)

Browse Source 
When the total page number is large enough (usually about 80+), sqlite will throw error: "Too many variables". This commit reduces the chunk size for sqlite configuration.
This commit is contained in:
scienceasdf 2021-01-30 03:16:33 +08:00 committed by GitHub
parent 52304a8149
commit 4b80bab88e
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 8 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
server/jobs/rebuild-tree.js
View File

@ -57,9 +57,15 @@ module.exports = async (pageId) => {
await WIKI.models.knex.table('pageTree').truncate() await WIKI.models.knex.table('pageTree').truncate()
if (tree.length > 0) { if (tree.length > 0) {
// -> Save in chunks, because of per query max parameters (35k Postgres, 2k MSSQL, 1k for SQLite) // -> Save in chunks, because of per query max parameters (35k Postgres, 2k MSSQL, 1k for SQLite)
if ((WIKI.config.db.type !== 'sqlite'))
for (const chunk of _.chunk(tree, 100)) { for (const chunk of _.chunk(tree, 100)) {
await WIKI.models.knex.table('pageTree').insert(chunk) await WIKI.models.knex.table('pageTree').insert(chunk)
} }
} else {
for (const chunk of _.chunk(tree, 60)) {
await WIKI.models.knex.table('pageTree').insert(chunk)
}
}
} }
await WIKI.models.knex.destroy() await WIKI.models.knex.destroy()