Slow Logging

V2 error reports
Post Reply
w9mdb
Old Man
Posts: 199
Joined: 13 Jul 2014, 12:05

Slow Logging

Post by w9mdb » 02 Feb 2020, 14:09

It takes around 15 seconds to log a QSO...mainly due to loading all the awards.
I tried deleting all the awards I don't care about but they are all "protected".

In the attached I show the UDP log request
13:54:20.158
It takes 1.5 seconds just to parse the ADIF record which should take about 10ms or so. the MoveNext is horrendously slow...
13:54:21.652 done with adif parsing
Then country analysis also seems to take too long but only 700ms at least -- same MoveNext slowness
13:54:22.366
Then we start Awards analysis which is the big hog
13:54:22.439
15 seconds later Awards analysis is done -- if only we could pick the award we care about....or speed up whatever is taking so long...the database queries are like 10ms but the MoveNext is taking longer than it should.
13:54:37.467

What c# library are you using for SQLite?
Attachments
Log4OMSlowLogging.txt
(53.94 KiB) Downloaded 73 times

wizgnome
Novice Class
Posts: 24
Joined: 16 Nov 2018, 14:46

Re: Slow Logging

Post by wizgnome » 06 Feb 2020, 11:21

It is taking around 34 seconds to log a QSO for me, and if I use JTALERT this always gives a log failure message.

2020-02-06 11:05:35.6881 INFO: [#=z7WMJzEjdrDmRepoUt9VP4_8=] : Begin ADIF import
2020-02-06 11:05:35.8311 INFO: [#=zDn_tT$ILUnksrAcHc9SUWfOf4TOJ] : Performing QSO search on callsign TA1BX
2020-02-06 11:05:35.9031 INFO: * [#=zDn_tT$ILUnksrAcHc9SUWfOf4TOJ][72 ms] : QSO search on callsign TA1BX completed
2020-02-06 11:05:35.9301 INFO: [#=zePm5BYI3IUChubTgVw==] : Award Management - Parse log started on 1 items
2020-02-06 11:05:35.9331 INFO: [AwardsDatabase] : Loading Awards list from database
2020-02-06 11:05:36.4291 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X / FT8 -9 FT8 EA7KIP IM76IF KN41 ???? ???????? Default
2020-02-06 11:05:36.6701 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X / FT8 -9 FT8 EA7KIP IM76IF???? ???? ???????? Default
2020-02-06 11:05:39.7233 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X 2.1.1 9c3311
2020-02-06 11:05:40.3943 WARN: [FwDateTime][StringToDate] : ConvertDate: cannot convert the input string 10101
2020-02-06 11:05:43.7245 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X / FT8 -9 FT8 EA7KIP IM76IF???? ???? ???????? Default
2020-02-06 11:05:54.7191 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X 2.1.1 9c3311
2020-02-06 11:05:55.2712 WARN: [FwDateTime][StringToDate] : ConvertDate: cannot convert the input string 10101
2020-02-06 11:05:59.6369 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X / FT8 -9 FT8 EA7KIP IM76IF???? ???? ???????? Default
2020-02-06 11:06:00.1699 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-Xa?(????????? ` ~ R6AK <HB0/HB9LCW> -05
2020-02-06 11:06:00.8330 INFO: [#=zSz745mHoIlC8y9gOpD7OsgU=] : ???? WSJT-X / FT8 -9 FT8 EA7KIP IM76IF???? ???? ???????? Default
2020-02-06 11:06:07.0593 INFO: * [AwardsDatabase][31126 ms] : Awards list retrieved from database
2020-02-06 11:06:07.1153 INFO: * [#=zePm5BYI3IUChubTgVw==][31184 ms] : Award Management - Parse log terminated
2020-02-06 11:06:07.1183 INFO: * [#=z7WMJzEjdrDmRepoUt9VP4_8=][31430 ms] : End of ADIF import
2020-02-06 11:06:07.1213 INFO: [#=zh4$C0MA9NszexTnsaNr$FjBlSHBX] : {d35d083f-305a-45fb-b726-083303b7d171} received 1 QSO
2020-02-06 11:06:07.1463 INFO: [#=zgJve__65v5ySrIbpcg==] : ############### ADD QSO Callsign: TA1BX Date: 06/02/2020 11:04:15 Band: 17m Mode: FT8
2020-02-06 11:06:07.9444 INFO: [#=zDn_tT$ILUnksrAcHc9SUWfOf4TOJ] : Performing QSO search on callsign TA1BX
2020-02-06 11:06:08.1364 INFO: [#=zvLagAAg9f2ZJVKJJqg==] : [HAMQTH] Search start on TA1BX (originally TA1BX)
2020-02-06 11:06:08.8158 INFO: [#=zvLagAAg9f2ZJVKJJqg==] : [HAMQTH] Search completed
2020-02-06 11:06:08.8198 INFO: * [#=zDn_tT$ILUnksrAcHc9SUWfOf4TOJ][875 ms] : QSO search on callsign TA1BX completed
2020-02-06 11:06:09.0938 INFO: [#=zgJve__65v5ySrIbpcg==] : QSO Callsign: TA1BX Date: 06/02/2020 11:04:15 Band: 17m Mode: FT8 Saved

The log is showing around 32 seconds to retrieve the Awards list. is there a way to speed this up?
73 de Mike G4GOU/EA7KIP

User avatar
IW3HMH
Site Admin
Posts: 2662
Joined: 21 Jan 2013, 14:20
Location: Quarto d'Altino - Venezia (ITA)
Contact:

Re: Slow Logging

Post by IW3HMH » 10 Feb 2020, 08:57

Hi,
thanks for the log.
We (i'm) not experiencing this amount of time but i'm checking the code searching for optimizations, as log is clear.
It should not be so slow at all.
Daniele Pistollato - IW3HMH

wizgnome
Novice Class
Posts: 24
Joined: 16 Nov 2018, 14:46

Re: Slow Logging

Post by wizgnome » 10 Feb 2020, 09:07

What makes it even more annoying is that I am not interested in most of the awards - I just upload my logs to EPC, LOTW and EQSL and use their systems for awards.

If it takes this amount of time, I would prefer to disable all the award checking if that was an option.
73 de Mike G4GOU/EA7KIP

w9mdb
Old Man
Posts: 199
Joined: 13 Jul 2014, 12:05

Re: Slow Logging

Post by w9mdb » 13 Feb 2020, 17:33

I've got over 30,000 QSLs so that may be a factor.

User avatar
DF5WW
Log4OM Alpha Team
Posts: 1563
Joined: 02 May 2013, 09:49
Location: Kraam, Rhineland Palatinate, Germany

Re: Slow Logging

Post by DF5WW » 13 Feb 2020, 17:59

Only a question. If you have more than 30000 QSL´s how much contacts contains your complete log ?
As off topic .... ;) ;)
73´s .. Juergen ... ALT-512 SDR (10W) , 50 m random wire at CG-3000 autotuner, Ailunce HS2 (20W and 5W VHF/UHF) to LPDA´s and different vertical´s ...

w9mdb
Old Man
Posts: 199
Joined: 13 Jul 2014, 12:05

Re: Slow Logging

Post by w9mdb » 19 Feb 2020, 22:21

I should've said QSOs and not QSLs.
33,864 QSOs

Mike

wizgnome
Novice Class
Posts: 24
Joined: 16 Nov 2018, 14:46

Re: Slow Logging

Post by wizgnome » 04 Mar 2020, 11:23

Log4OM version 2.4.0.0 is a lot faster and I no longer have an issue logging with WSJT-X -> JTAlert -> Log4OM
73 de Mike G4GOU/EA7KIP

Post Reply