Page 1 of 1

Slow Logging

Posted: 02 Feb 2020, 14:09
by w9mdb
It takes around 15 seconds to log a QSO...mainly due to loading all the awards.
I tried deleting all the awards I don't care about but they are all "protected".

In the attached I show the UDP log request
13:54:20.158
It takes 1.5 seconds just to parse the ADIF record which should take about 10ms or so. the MoveNext is horrendously slow...
13:54:21.652 done with adif parsing
Then country analysis also seems to take too long but only 700ms at least -- same MoveNext slowness
13:54:22.366
Then we start Awards analysis which is the big hog
13:54:22.439
15 seconds later Awards analysis is done -- if only we could pick the award we care about....or speed up whatever is taking so long...the database queries are like 10ms but the MoveNext is taking longer than it should.
13:54:37.467

What c# library are you using for SQLite?

Re: Slow Logging

Posted: 06 Feb 2020, 11:21
by g4gou
It is taking around 34 seconds to log a QSO for me, and if I use JTALERT this always gives a log failure message.

2020-02-06 11:05:35.6881 INFO: [#=z7WMJzEjdrDmRepoUt9VP4_8=] : Begin ADIF import
2020-02-06 11:05:35.8311 INFO: [#=zDn_tT$ILUnksrAcHc9SUWfOf4TOJ] : Performing QSO search on callsign TA1BX
2020-02-06 11:05:35.9031 INFO: * [#=zDn_tT$ILUnksrAcHc9SUWfOf4TOJ][72 ms] : QSO search on callsign TA1BX completed
2020-02-06 11:05:35.9301 INFO: [#=zePm5BYI3IUChubTgVw==] : Award Management - Parse log started on 1 items
2020-02-06 11:05:35.9331 INFO: [AwardsDatabase] : Loading Awards list from database
2020-02-06 11:05:36.4291 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X / FT8 -9 FT8 EA7KIP IM76IF KN41 ???? ???????? Default
2020-02-06 11:05:36.6701 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X / FT8 -9 FT8 EA7KIP IM76IF???? ???? ???????? Default
2020-02-06 11:05:39.7233 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X 2.1.1 9c3311
2020-02-06 11:05:40.3943 WARN: [FwDateTime][StringToDate] : ConvertDate: cannot convert the input string 10101
2020-02-06 11:05:43.7245 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X / FT8 -9 FT8 EA7KIP IM76IF???? ???? ???????? Default
2020-02-06 11:05:54.7191 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X 2.1.1 9c3311
2020-02-06 11:05:55.2712 WARN: [FwDateTime][StringToDate] : ConvertDate: cannot convert the input string 10101
2020-02-06 11:05:59.6369 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X / FT8 -9 FT8 EA7KIP IM76IF???? ???? ???????? Default
2020-02-06 11:06:00.1699 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-Xa?(????????? ` ~ R6AK <HB0/HB9LCW> -05
2020-02-06 11:06:00.8330 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X / FT8 -9 FT8 EA7KIP IM76IF???? ???? ???????? Default
2020-02-06 11:06:07.0593 INFO: * [AwardsDatabase][31126 ms] : Awards list retrieved from database
2020-02-06 11:06:07.1153 INFO: * [#=zePm5BYI3IUChubTgVw==][31184 ms] : Award Management - Parse log terminated
2020-02-06 11:06:07.1183 INFO: * [#=z7WMJzEjdrDmRepoUt9VP4_8=][31430 ms] : End of ADIF import
2020-02-06 11:06:07.1213 INFO: [#=zh4$C0MA9NszexTnsaNr$FjBlSHBX] : {d35d083f-305a-45fb-b726-083303b7d171} received 1 QSO
2020-02-06 11:06:07.1463 INFO: [#=zgJve__65v5ySrIbpcg==] : ############### ADD QSO Callsign: TA1BX Date: 06/02/2020 11:04:15 Band: 17m Mode: FT8
2020-02-06 11:06:07.9444 INFO: [#=zDn_tT$ILUnksrAcHc9SUWfOf4TOJ] : Performing QSO search on callsign TA1BX
2020-02-06 11:06:08.1364 INFO: [#=zvLagAAg9f2ZJVKJJqg==] : [HAMQTH] Search start on TA1BX (originally TA1BX)
2020-02-06 11:06:08.8158 INFO: [#=zvLagAAg9f2ZJVKJJqg==] : [HAMQTH] Search completed
2020-02-06 11:06:08.8198 INFO: * [#=zDn_tT$ILUnksrAcHc9SUWfOf4TOJ][875 ms] : QSO search on callsign TA1BX completed
2020-02-06 11:06:09.0938 INFO: [#=zgJve__65v5ySrIbpcg==] : QSO Callsign: TA1BX Date: 06/02/2020 11:04:15 Band: 17m Mode: FT8 Saved

The log is showing around 32 seconds to retrieve the Awards list. is there a way to speed this up?

Re: Slow Logging

Posted: 10 Feb 2020, 08:57
by IW3HMH
Hi,
thanks for the log.
We (i'm) not experiencing this amount of time but i'm checking the code searching for optimizations, as log is clear.
It should not be so slow at all.

Re: Slow Logging

Posted: 10 Feb 2020, 09:07
by g4gou
What makes it even more annoying is that I am not interested in most of the awards - I just upload my logs to EPC, LOTW and EQSL and use their systems for awards.

If it takes this amount of time, I would prefer to disable all the award checking if that was an option.

Re: Slow Logging

Posted: 13 Feb 2020, 17:33
by w9mdb
I've got over 30,000 QSLs so that may be a factor.

Re: Slow Logging

Posted: 13 Feb 2020, 17:59
by DF5WW
Only a question. If you have more than 30000 QSL´s how much contacts contains your complete log ?
As off topic .... ;) ;)

Re: Slow Logging

Posted: 19 Feb 2020, 22:21
by w9mdb
I should've said QSOs and not QSLs.
33,864 QSOs

Mike

Re: Slow Logging

Posted: 04 Mar 2020, 11:23
by g4gou
Log4OM version 2.4.0.0 is a lot faster and I no longer have an issue logging with WSJT-X -> JTAlert -> Log4OM