Page 2 of 3
Re: It take longer now to log a qso
Posted: 12 Mar 2024, 08:10
by 9k2hn
The manual says if you have more than 100k qso it is better to use MYSQL, I do have 526k qso.
Is moving to sqlite is good option?
Re: It take longer now to log a qso
Posted: 12 Mar 2024, 09:12
by G4POP
Wow!
No with a log like that stick with Mysql but you need to manage the Mysql database properly and I am not an expert on fine tuning MSQL
Re: It take longer now to log a qso
Posted: 12 Mar 2024, 09:27
by 9k2hn
While importing my log in patches I noticed that when I reached 200k qso all was great and fast but after that, it started to get very slow.
I hope someone on this forum can guide me on how to fine-tune MySQL to be faster (I'm open for suggestion)
Re: It take longer now to log a qso
Posted: 12 Mar 2024, 16:34
by 9k2hn
But something for sure in the latest release of 2.31.0.0 made it much slower than before
Re: It take longer now to log a qso
Posted: 12 Mar 2024, 17:47
by IW3HMH
may i ask an ADIF of your log? (downloadable from somewhere if possible)
Seems really huge and, surely, a good benchmark for me to improve current implementation...
i will try adding some indexes and check how they performs on mysql, then i will add them to default installation and i will send you scripts
Thanks
Re: It take longer now to log a qso
Posted: 12 Mar 2024, 18:38
by 9k2hn
Email is sent to you with a link to my full logbook around 1 GB in size
Re: It take longer now to log a qso
Posted: 13 Mar 2024, 17:46
by IV3IPS
I had the exact same problem. The database was in the PC Google Drive folder. I did a test by moving the database to the c:\documents folder.... solved the problem ! Now it saves qso's in reasonable time. I hope I've been helpful.
73 Stefano IV3IPS.
Re: It take longer now to log a qso
Posted: 16 Mar 2024, 07:36
by 9k2hn
I Have moved now to SQLite and it is working quite fast, my question is there any future issues with a logbook with 500k qso and SQLite?
Re: It take longer now to log a qso
Posted: 16 Mar 2024, 08:12
by G4POP
In theory no but see how you get on.
I am convinced there has been some change in MySQL that we dont know about causing odd issues for some users
Re: It take longer now to log a qso
Posted: 16 Mar 2024, 12:51
by w9mdb
Google Drive syncs take around 20 minutes or more.
So everything probably works OK for a while and then slows down for a while.
So I'd think it would be every other QSO or such.
Google Drive probably locks the file to upload it (so it doesn't change under foot) and that's when mysql will wait until the lock is released.
MySQL will not lock the file as that's the whole point of a database like that to allow multiple access.
If I were you I'd just run a periodic job to copy your database to Google Drive. No problem then on locking.