Statistics won't load if there are too many heart beats

[Chaosflo]

Describe the bug
Hej!
First of all, great thing you wrote here, thanks!
I wanted to view my statistics but I can't open it at all.
Waited 5 minutes but nothing changed.

My guess is following:
The last three days I worked hard on a project and had about 3 instances of rider open plus chrome.
This would mean (correct me if I am wrong) that many heartbeats were written.
Too many for the UI to handle.

{"time":"2025-11-19T11:09:32.304614467Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/summary?interval=today","duration":106106739,"bytes":1135556,"addr":"172.17.0.1:58454","user":"Florian"}

I expect that I can watch days like this as well.
I expect that the filtering is active while loading (so that I can change the filter to load faster)
Maybe add hour to the time filter.

Currently I am unable to use this software at all!
The only way I can use this data is opening the sql database and query it!

System information
Please provide information on:

• v2.16.0
• Operating system
  • Docker with image: muety/wakapi:latest
• Database : sqlite3

[muety]

Thanks for reporting. Since the UI doesn't cope with raw heartbeats but only displays aggregated statistics, many heartbeats are not a problem. In production at wakapi.dev, we have tens of millions of heartbeats processed in seconds. There must be something else going wrong there.

Can you try to describe the problem in more detail, please? What exactly do you see in your browser? Just nothing? An empty page? Empty charts? Could you perhaps even record a short screen cast that depicts the issue? While recording, keep your browser's DevTools window open in the Console tab so we can inspect potential client-side errors.

[Chaosflo]

Hej
Sorry for replying late.

I wanted to open the summary as this log shows

{"time":"2025-11-19T11:09:32.304614467Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/summary?interval=today","duration":106106739,"bytes":1135556,"addr":"172.17.0.1:58454","user":"Florian"}

If we take apart the log message

URI: /summary?interval=today
duration: 106106739
bytes: 1135556

When I reported the bug I just wanted to open the summary page of today.
Which took for ages which you see at the duration.
I think the amount of bytes was the reason behind this.

But how can this happen if you say, the values get aggregated? =/
Hmm

I looked closer at the logs.
All of the showed a slow execution.
I don't know much about sqlite3, but could it be some issues with the database?

{"time":"2025-11-19T11:07:13.465139223Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/projects","duration":1177115,"bytes":24089,"addr":"172.17.0.1:35408","user":"Florian"}

{"time":"2025-11-19T11:07:13.530140298Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":26982650,"bytes":49,"addr":"172.17.0.1:43668","user":"Florian"}

{"time":"2025-11-19T11:07:13.719312191Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/summary?interval=any&project=CloudPlcService","duration":238896150,"bytes":93763,"addr":"172.17.0.1:35408","user":"Florian"}

{"time":"2025-11-19T11:07:13.727196687Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/summary?interval=today&language=C%23&project=DataHub.Site.Tools","duration":235816306,"bytes":267022,"addr":"172.17.0.1:35406","user":"Florian"}

{"time":"2025-11-19T11:07:13.901030043Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/api/badge/Florian/interval:today/project:DataHub.Site.Tools","duration":16123137,"bytes":839,"addr":"172.17.0.1:35396","user":"Florian"}

{"time":"2025-11-19T11:07:14.049520141Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":12576228,"bytes":49,"addr":"172.17.0.1:43668","user":"Florian"}

{"time":"2025-11-19T11:07:51.679253885Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/summary?from=2025-11-20&to=2025-11-20","duration":1985709,"bytes":35330,"addr":"172.17.0.1:48812","user":"Florian"}

{"time":"2025-11-19T11:07:51.846845223Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":8641759,"bytes":49,"addr":"172.17.0.1:48858","user":"Florian"}

{"time":"2025-11-19T11:08:10.96029051Z","level":"INFO","msg":"[request]","status":404,"method":"GET","uri":"/.well-known/appspecific/com.chrome.devtools.json","duration":17826,"bytes":19,"addr":"172.17.0.1:48824","user":"-"}

{"time":"2025-11-19T11:08:12.300209082Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":10520527,"bytes":49,"addr":"172.17.0.1:48858","user":"Florian"}

{"time":"2025-11-19T11:08:12.480683698Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/summary?from=2025-11-19&to=2025-11-20","duration":101740464,"bytes":1135546,"addr":"172.17.0.1:48824","user":"Florian"}

{"time":"2025-11-19T11:08:12.508765601Z","level":"INFO","msg":"[request]","status":404,"method":"GET","uri":"/.well-known/appspecific/com.chrome.devtools.json","duration":40113,"bytes":19,"addr":"172.17.0.1:48824","user":"-"}

{"time":"2025-11-19T11:09:19.849215213Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":12415801,"bytes":49,"addr":"172.17.0.1:52384","user":"Florian"}

{"time":"2025-11-19T11:09:31.588915709Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/api/users/current/statusbar/today","duration":42425330,"bytes":4956,"addr":"172.17.0.1:58438","user":"Florian"}

{"time":"2025-11-19T11:09:32.074617052Z","level":"INFO","msg":"[request]","status":302,"method":"GET","uri":"/","duration":201553,"bytes":31,"addr":"172.17.0.1:58442","user":"Florian"}

{"time":"2025-11-19T11:09:32.202061335Z","level":"INFO","msg":"[request]","status":302,"method":"GET","uri":"/summary?interval=today","duration":116032836,"bytes":923698,"addr":"172.17.0.1:58442","user":"Florian"}

{"time":"2025-11-19T11:09:32.304614467Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/summary?interval=today","duration":106106739,"bytes":1135556,"addr":"172.17.0.1:58454","user":"Florian"}

{"time":"2025-11-19T11:09:35.691060032Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":18764416,"bytes":49,"addr":"172.17.0.1:52384","user":"Florian"}

{"time":"2025-11-19T11:09:45.608143789Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk","duration":28148096,"bytes":148,"addr":"172.17.0.1:33388","user":"Florian"}

{"time":"2025-11-19T11:09:45.703780443Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk","duration":14700723,"bytes":181,"addr":"172.17.0.1:33402","user":"Florian"}

{"time":"2025-11-19T11:10:04.804165992Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":10186413,"bytes":49,"addr":"172.17.0.1:52384","user":"Florian"}

{"time":"2025-11-19T11:10:06.775926344Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":9818777,"bytes":49,"addr":"172.17.0.1:52384","user":"Florian"}

{"time":"2025-11-19T11:11:04.143584643Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":16031019,"bytes":49,"addr":"172.17.0.1:35796","user":"Florian"}

{"time":"2025-11-19T11:11:11.758575792Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":10684541,"bytes":49,"addr":"172.17.0.1:35796","user":"Florian"}

{"time":"2025-11-19T11:11:13.784148611Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":12009386,"bytes":49,"addr":"172.17.0.1:35796","user":"Florian"}

{"time":"2025-11-19T11:11:14.463098181Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":12603667,"bytes":49,"addr":"172.17.0.1:35796","user":"Florian"}

{"time":"2025-11-19T11:11:16.678312016Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":18030581,"bytes":49,"addr":"172.17.0.1:35796","user":"Florian"}

{"time":"2025-11-19T11:11:17.18584704Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":11719965,"bytes":115,"addr":"172.17.0.1:35796","user":"Florian"}

[Chaosflo]

Now I could reproduce the issue!

If I want my summaries from yesterday, they load ages.
But they load if you wait a few minutes.

This is the whole logs I get from this sessions.
Docker container stats were pretty low.

Is the problem the pre computation mentioned here, because it simply didn't run?

{"time":"2025-11-25T06:49:30.126600405Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/summary?interval=yesterday","duration":264543672,"bytes":1055491,"addr":"172.17.0.1:46108","user":"Florian"}

{"time":"2025-11-25T06:49:48.817354806Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":10690365,"bytes":49,"addr":"172.17.0.1:39406","user":"Florian"}

{"time":"2025-11-25T06:49:59.314850484Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":10636305,"bytes":49,"addr":"172.17.0.1:57296","user":"Florian"}

{"time":"2025-11-25T06:50:07.771032477Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":12450325,"bytes":49,"addr":"172.17.0.1:57296","user":"Florian"}

{"time":"2025-11-25T06:50:27.184167081Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":14575452,"bytes":82,"addr":"172.17.0.1:57296","user":"Florian"}

{"time":"2025-11-25T06:51:15.180855813Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":8687916,"bytes":49,"addr":"172.17.0.1:53432","user":"Florian"}

{"time":"2025-11-25T06:51:20.18193982Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/summary?interval=yesterday","duration":146486823,"bytes":1055491,"addr":"172.17.0.1:33088","user":"Florian"}

{"time":"2025-11-25T06:51:20.759443821Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/api/activity/chart/Florian.svg?dark&noattr","duration":463086159,"bytes":2582,"addr":"172.17.0.1:33114","user":"Florian"}

{"time":"2025-11-25T06:51:42.579103513Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":10784368,"bytes":49,"addr":"172.17.0.1:53432","user":"Florian"}

{"time":"2025-11-25T06:52:17.854911022Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":18640474,"bytes":49,"addr":"172.17.0.1:48412","user":"Florian"}

{"time":"2025-11-25T06:52:17.869271401Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":15811331,"bytes":49,"addr":"172.17.0.1:48436","user":"Florian"}

{"time":"2025-11-25T06:52:18.048795566Z","level":"INFO","msg":"[request]","status":201,"method":"POST","uri":"/api/users/current/heartbeats.bulk?api_key=d450595f-bf7c-40e4-b423-d017278eeb34","duration":202416691,"bytes":49,"addr":"172.17.0.1:48430","user":"Florian"}

{"time":"2025-11-25T06:52:18.076775292Z","level":"INFO","msg":"[request]","status":200,"method":"GET","uri":"/summary?interval=yesterday","duration":233249141,"bytes":1055491,"addr":"172.17.0.1:48416","user":"Florian"}

[muety]

The GET requests only take ~ 260 ms, which is totally fine. Page unresponsive hints at your browser being the one to block execution, so it's probably a client-side issue for whatever reason.

Can you please bring up your browser's DevTools and take a screenshot of the Console and Network tabs after a successful page load? Also, do you have any (unusual) browser add-ons installed?

[Chaosflo]

Yeah sure!

Nothing got logged in the console.

I also attached a chrome performance tracing, maybe this helps further.

Trace-20251126T154620.json.gz

Regarding extensions, I tried in the incognito tab where no extensions are enable, same result.

Hope this helps

[muety]

Very strange. I'm a bit stumped there. Could you possibly even record a short screencast that depicts the issue? Perhaps that helps debugging this further. I suspect it's a client-side problem, but as you already pointed out, there's nothing suspicious in the logs... 🤔.

[Chaosflo]

Hej
Sorry for the later answer, its quite difficult to record a video!
Interesting thing I found, is that sometimes this

Will not displayed.

Here is the video, I had to censor much of this, but I hope this is enough.

recording.webm

[muety]

Sorry for not getting back to you sooner.

I tried to derive some insights from the performance tracing dump you sent. While I'm not particularly an expert in interpreting those traces, it seems like most time is spent on some Chart.js function that is called an almost countless number of times in a row. No idea why that is, though.

Can you show a screenshot of your dashboard, please? Are there excessively many small bar chart segments or something, which might cause Chart.js to break down?

Also, all function calls are "wrapped" by some other function call triggered from the nngceckbapebfimnlniiiahkandclblb extension (Bitwarden plugin, apparently). While I don't think that's any related to the issue, can you please still try to open Wakapi (a) with that plugin disabled and (b) in a while different browser (e.g. Firefox)?

Sorry for all the inconvenience.

[Chaosflo]

Hej
No worries, I tried already opening the site with Incokognito mode in chrome.
In this mode all extensions are disabled, the last time I checked its the same problem.
As said, sadly I cannot show you my dashboard out of privacy reasons

But I can fully agree that there are MANY small elements in the 'Hourly Breakdown' chart.
When I try to scroll with my mouse in this chart, the site is reloading also showing me this message (about the site not responding)
So yeah, I think this is the issue.

Hmm
What can we do about it? =?

Greetings

[muety]

I see, so the issue does actually seem to be about Chart.js struggling to render all those data points. The Timeline chart displays at max 30 days, while the Hourly Breakdown chart even only shows the past 24 hours, so I'm wondering where those excessively many chart items come from 🤔.

Which of the dashboard's chart is most crowded, i.e. which one do you suspect do cause those performance issues?

Can you please report what your heartbeats timeout is set to (Settings -> Data) and can also please report the result of the following query?

select count(*) from durations where time >= '2025-11-24' and time < '2025-11-25';

[muety]

Sorry to bother you, but any news on this? Would love to fix this strange issue, but need your support on that.