Logs
Live Cloud Logging query (nothing stored) · master ·
last 6h ·
newest first · page 1 (200/page) · 200 entries in 798 ms
all
app
neo4j
weaviate
time
relative
absolute
7s ago2026-07-27 02:17:42 UTC DEBUG docproc Reported pending workload
time2026-07-27 02:17:42 UTC
severityDEBUG
servicedocproc
sourcejobs/hpa_pending_workload.py:176
clustermaster
version0.1.0
poddocproc-7bc76669-ljh8h
message
Reported pending workload
raw payload (15 fields)
{
"backlog_capped": 0.0,
"caller": "jobs/hpa_pending_workload.py:176",
"cluster": "master",
"component": "hpa_pending_workload",
"environment": "DEVELOPMENT",
"in_progress_count": 0.0,
"message": "Reported pending workload",
"num_replicas": 1.0,
"recovery_workload": 0.0,
"service": "docproc",
"signal": 0.0,
"timestamp": "2026-07-27T02:17:42.900Z",
"total_workload": 0.0,
"unacked": 0.0,
"version": "0.1.0"
}7s ago2026-07-27 02:17:42 UTC DEBUG docproc Pub/Sub num_unacked result: project_id=tilda-trial-automation subscription_id_in_filter=tilda-document-master-docproc-sub num_series=1 total=0
time2026-07-27 02:17:42 UTC
severityDEBUG
servicedocproc
sourcejobs/cloud_monitoring_metrics.py:296
clustermaster
version0.1.0
poddocproc-7bc76669-ljh8h
message
Pub/Sub num_unacked result: project_id=tilda-trial-automation subscription_id_in_filter=tilda-document-master-docproc-sub num_series=1 total=0
raw payload (7 fields)
{
"caller": "jobs/cloud_monitoring_metrics.py:296",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Pub/Sub num_unacked result: project_id=tilda-trial-automation subscription_id_in_filter=tilda-document-master-docproc-sub num_series=1 total=0",
"service": "docproc",
"timestamp": "2026-07-27T02:17:42.824Z",
"version": "0.1.0"
}9s ago2026-07-27 02:17:40 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:40 UTC
severityINFO
clustermaster
podrag-agent-57879dd94f-l9nz7
10s ago2026-07-27 02:17:39 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:39 UTC
severityINFO
clustermaster
podrag-agent-57879dd94f-l9nz7
12s ago2026-07-27 02:17:37 UTC neo4j advpsvc match(a:AdvRateRule{deleted:true})-[r]-(b) with distinct a return a.portalorgid, a.tildaid, a.ruletype limit 10
time2026-07-27 02:17:37 UTC
severityINFO
serviceadvpsvc
clustermaster
podserver-1-dev-0
query
match(a:AdvRateRule{deleted:true})-[r]-(b)
with distinct a
return a.portalorgid, a.tildaid, a.ruletype
limit 10
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 2.0,
"elapsedTimeMs": 2.0,
"executionPlanCacheKeyHash": "AFAFBFFB",
"id": "17603532",
"pageFaults": 0.0,
"pageHits": 1160.0,
"planning": 0.0,
"query": "match(a:AdvRateRule{deleted:true})-[r]-(b) with distinct a return a.portalorgid, a.tildaid, a.ruletype limit 10",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:37.198Z",
"transactionId": 1776283.0,
"waiting": 0.0
}13s ago2026-07-27 02:17:36 UTC DEBUG virtual-assistant [mem] background_reclaimer executed
time2026-07-27 02:17:36 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/main.py:540
clustermaster
versionunknown
podvirtual-assistant-65b975d66b-l8wpw
message
[mem] background_reclaimer executed
raw payload (7 fields)
{
"caller": "src/main.py:540",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[mem] background_reclaimer executed",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:36.796Z",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC DEBUG virtual-assistant aggressive_memory_release: GC skipped based on should_run_gc() decision
time2026-07-27 02:17:36 UTC
severityDEBUG
servicevirtual-assistant
sourcecommon/mem_release.py:79
clustermaster
versionunknown
podvirtual-assistant-65b975d66b-l8wpw
message
aggressive_memory_release: GC skipped based on should_run_gc() decision
raw payload (7 fields)
{
"caller": "common/mem_release.py:79",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "aggressive_memory_release: GC skipped based on should_run_gc() decision",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:36.796Z",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC DEBUG virtual-assistant should_run_gc: mem usage: 22.9% (457.8MB/2000.0MB), GC gen0 counts=307
time2026-07-27 02:17:36 UTC
severityDEBUG
servicevirtual-assistant
sourcereg/memory_monitor.py:464
clustermaster
versionunknown
podvirtual-assistant-65b975d66b-l8wpw
message
should_run_gc: mem usage: 22.9% (457.8MB/2000.0MB), GC gen0 counts=307
raw payload (7 fields)
{
"caller": "reg/memory_monitor.py:464",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "should_run_gc: mem usage: 22.9% (457.8MB/2000.0MB), GC gen0 counts=307",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:36.795Z",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC DEBUG tusker task.Description has unresolved placeholders, task.Id: c7a633cf-f491-4408-a1cb-af5fe8f4cc27
time2026-07-27 02:17:36 UTC
severityDEBUG
servicetusker
sourcejobs/task_template.go:219
clustermaster
versionunknown
podtusker-858b678c65-hsvqd
message
task.Description has unresolved placeholders, task.Id: c7a633cf-f491-4408-a1cb-af5fe8f4cc27
raw payload (7 fields)
{
"caller": "jobs/task_template.go:219",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "task.Description has unresolved placeholders, task.Id: c7a633cf-f491-4408-a1cb-af5fe8f4cc27",
"service": "tusker",
"timestamp": "2026-07-27T02:17:36.675Z",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC DEBUG tusker task.Description has unresolved placeholders, task.Id: aed29e6b-6758-4d7e-9a68-714008e36fa8
time2026-07-27 02:17:36 UTC
severityDEBUG
servicetusker
sourcejobs/task_template.go:219
clustermaster
versionunknown
podtusker-858b678c65-hsvqd
message
task.Description has unresolved placeholders, task.Id: aed29e6b-6758-4d7e-9a68-714008e36fa8
raw payload (7 fields)
{
"caller": "jobs/task_template.go:219",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "task.Description has unresolved placeholders, task.Id: aed29e6b-6758-4d7e-9a68-714008e36fa8",
"service": "tusker",
"timestamp": "2026-07-27T02:17:36.675Z",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC DEBUG tusker task.Description has unresolved placeholders, task.Id: 4311cf38-13bc-45fb-9014-3fdb932c9304
time2026-07-27 02:17:36 UTC
severityDEBUG
servicetusker
sourcejobs/task_template.go:219
clustermaster
versionunknown
podtusker-858b678c65-hsvqd
message
task.Description has unresolved placeholders, task.Id: 4311cf38-13bc-45fb-9014-3fdb932c9304
raw payload (7 fields)
{
"caller": "jobs/task_template.go:219",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "task.Description has unresolved placeholders, task.Id: 4311cf38-13bc-45fb-9014-3fdb932c9304",
"service": "tusker",
"timestamp": "2026-07-27T02:17:36.674Z",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC ERROR tusker failed to deliver task
time2026-07-27 02:17:36 UTC
severityERROR
servicetusker
sourcejobs/task_template.go:293
clustermaster
versionunknown
podtusker-858b678c65-hsvqd
message
failed to deliver task
raw payload (10 fields)
{
"caller": "jobs/task_template.go:293",
"category": "DOAInvestigatorSignoff",
"cluster": "master",
"environment": "DEVELOPMENT",
"error": "No inbox found for user d54cc7dd-0519-4a5c-a965-a72742adadfa",
"message": "failed to deliver task",
"service": "tusker",
"task_id": "facf3a7a-9881-4f93-8235-034f7de1c9d0",
"timestamp": "2026-07-27T02:17:36.588Z",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC WARNING tusker no inbox found for assigned user
time2026-07-27 02:17:36 UTC
severityWARNING
servicetusker
sourcetasklib/tasklib.go:138
clustermaster
versionunknown
podtusker-858b678c65-hsvqd
message
no inbox found for assigned user
raw payload (9 fields)
{
"caller": "tasklib/tasklib.go:138",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "no inbox found for assigned user",
"service": "tusker",
"taskId": "facf3a7a-9881-4f93-8235-034f7de1c9d0",
"timestamp": "2026-07-27T02:17:36.588Z",
"userId": "d54cc7dd-0519-4a5c-a965-a72742adadfa",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC neo4j tusker match (u:User{tildaid:"d54cc7dd-0519-4a5c-a965-a72742adadfa"})<-[:OWNED_BY]-(i:Inbox{type:"User"}) where u.email = i.name return i
time2026-07-27 02:17:36 UTC
severityINFO
servicetusker
clustermaster
podserver-2-dev-0
query
match (u:User{tildaid:"d54cc7dd-0519-4a5c-a965-a72742adadfa"})<-[:OWNED_BY]-(i:Inbox{type:"User"})
where u.email = i.name
return i
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "7E52316A",
"id": "25358532",
"pageFaults": 0.0,
"pageHits": 9.0,
"planning": 0.0,
"query": "\n\t\tmatch (u:User{tildaid:\"d54cc7dd-0519-4a5c-a965-a72742adadfa\"})\u003c-[:OWNED_BY]-(i:Inbox{type:\"User\"})\n\t\twhere u.email = i.name\n\t\treturn i",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tGo Driver/5.20.0\t\tclient/10.129.0.236:35900\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:36.587Z",
"transactionId": 12244885.0,
"waiting": 0.0
}13s ago2026-07-27 02:17:36 UTC ERROR tusker failed to deliver task
time2026-07-27 02:17:36 UTC
severityERROR
servicetusker
sourcejobs/task_template.go:293
clustermaster
versionunknown
podtusker-858b678c65-hsvqd
message
failed to deliver task
raw payload (10 fields)
{
"caller": "jobs/task_template.go:293",
"category": "Signoff1572",
"cluster": "master",
"environment": "DEVELOPMENT",
"error": "No inbox found for user d54cc7dd-0519-4a5c-a965-a72742adadfa",
"message": "failed to deliver task",
"service": "tusker",
"task_id": "b5e2156f-16f0-4764-adc3-502a366dd4dc",
"timestamp": "2026-07-27T02:17:36.585Z",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC WARNING tusker no inbox found for assigned user
time2026-07-27 02:17:36 UTC
severityWARNING
servicetusker
sourcetasklib/tasklib.go:138
clustermaster
versionunknown
podtusker-858b678c65-hsvqd
message
no inbox found for assigned user
raw payload (9 fields)
{
"caller": "tasklib/tasklib.go:138",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "no inbox found for assigned user",
"service": "tusker",
"taskId": "b5e2156f-16f0-4764-adc3-502a366dd4dc",
"timestamp": "2026-07-27T02:17:36.585Z",
"userId": "d54cc7dd-0519-4a5c-a965-a72742adadfa",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC neo4j tusker match (u:User{tildaid:"d54cc7dd-0519-4a5c-a965-a72742adadfa"})<-[:OWNED_BY]-(i:Inbox{type:"User"}) where u.email = i.name return i
time2026-07-27 02:17:36 UTC
severityINFO
servicetusker
clustermaster
podserver-2-dev-0
query
match (u:User{tildaid:"d54cc7dd-0519-4a5c-a965-a72742adadfa"})<-[:OWNED_BY]-(i:Inbox{type:"User"})
where u.email = i.name
return i
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "7E52316A",
"id": "25358531",
"pageFaults": 0.0,
"pageHits": 44.0,
"planning": 0.0,
"query": "\n\t\tmatch (u:User{tildaid:\"d54cc7dd-0519-4a5c-a965-a72742adadfa\"})\u003c-[:OWNED_BY]-(i:Inbox{type:\"User\"})\n\t\twhere u.email = i.name\n\t\treturn i",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tGo Driver/5.20.0\t\tclient/10.129.0.236:35900\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:36.584Z",
"transactionId": 12244885.0,
"waiting": 0.0
}13s ago2026-07-27 02:17:36 UTC DEBUG tusker task.Description has unresolved placeholders, task.Id: d4064a28-60b5-423a-ba7d-acd699a856d1
time2026-07-27 02:17:36 UTC
severityDEBUG
servicetusker
sourcejobs/task_template.go:219
clustermaster
versionunknown
podtusker-858b678c65-hsvqd
message
task.Description has unresolved placeholders, task.Id: d4064a28-60b5-423a-ba7d-acd699a856d1
raw payload (7 fields)
{
"caller": "jobs/task_template.go:219",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "task.Description has unresolved placeholders, task.Id: d4064a28-60b5-423a-ba7d-acd699a856d1",
"service": "tusker",
"timestamp": "2026-07-27T02:17:36.582Z",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC DEBUG tusker task.Description has unresolved placeholders, task.Id: 55a690c2-286e-4cae-a329-98a8a353aa48
time2026-07-27 02:17:36 UTC
severityDEBUG
servicetusker
sourcejobs/task_template.go:219
clustermaster
versionunknown
podtusker-858b678c65-hsvqd
message
task.Description has unresolved placeholders, task.Id: 55a690c2-286e-4cae-a329-98a8a353aa48
raw payload (7 fields)
{
"caller": "jobs/task_template.go:219",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "task.Description has unresolved placeholders, task.Id: 55a690c2-286e-4cae-a329-98a8a353aa48",
"service": "tusker",
"timestamp": "2026-07-27T02:17:36.581Z",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC DEBUG tusker task.Description has unresolved placeholders, task.Id: efa055f4-d754-4f4f-b28a-af8473349c17
time2026-07-27 02:17:36 UTC
severityDEBUG
servicetusker
sourcejobs/task_template.go:219
clustermaster
versionunknown
podtusker-858b678c65-hsvqd
message
task.Description has unresolved placeholders, task.Id: efa055f4-d754-4f4f-b28a-af8473349c17
raw payload (7 fields)
{
"caller": "jobs/task_template.go:219",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "task.Description has unresolved placeholders, task.Id: efa055f4-d754-4f4f-b28a-af8473349c17",
"service": "tusker",
"timestamp": "2026-07-27T02:17:36.581Z",
"version": "unknown"
}13s ago2026-07-27 02:17:36 UTC neo4j tusker MATCH (study:Study )-[:MANAGED_BY]-(:Inbox)-[:BELONGS_TO]-(t:Task) WHERE NOT EXISTS ((t)-[:BELONGS_TO]-(:Inbox{type:"User"})) CALL...
time2026-07-27 02:17:36 UTC
severityINFO
servicetusker
clustermaster
podserver-2-dev-0
query
MATCH (study:Study )-[:MANAGED_BY]-(:Inbox)-[:BELONGS_TO]-(t:Task)
WHERE NOT EXISTS ((t)-[:BELONGS_TO]-(:Inbox{type:"User"}))
CALL {
WITH t
MATCH (t)<-[:CREATED_FROM_SPEC]-(ptc:ParticipantTaskConfig)-[:PARTICIPANT_TASKCONFIG]-(:ParticipantTaskList)-[:PARTICIPANT_TASKLIST]-(:ParticipantControl)-[:PARTICIPANT_CONTROL]-(:ParticipantActivity)-[:PARTICIPANT_ACTIVITY]-(pw:ParticipantWorkflow)
RETURN ptc, pw
UNION ALL
WITH t
MATCH (t)<-[:CREATED_FROM_SPEC]-(ptc:ParticipantTaskConfig)-[:PARTICIPANT_TASKCONFIG]-(:ParticipantTaskList)-[:PARTICIPANT_TASKLIST]-(:ParticipantActivity)-[:PARTICIPANT_ACTIVITY]-(pw:ParticipantWorkflow)
RETURN ptc, pw
}
WITH DISTINCT study, t, ptc, pw
MATCH (t)-[:BELONGS_TO]-(:Inbox)-[:MANAGED_BY]-(o:Organization)
MATCH (ptc)-[:BELONGS_TO_TASKCONFIG]-(tc:TaskConfig)
OPTIONAL MATCH (t)-[:BELONGS_TO]-(taskInbox:Inbox{type:"User"})--(taskUser:User)
OPTIONAL MATCH (pw)-[:PARTICIPANTWORKFLOW_TO_SCOPE]-(:StudySiteActor)-[:STUDYSITEACTOR_TO_ACTOR]-(:Actor{delpending:false})-[:FOR_USER]-(user:User)
OPTIONAL MATCH (pw)-[:PARTICIPANTWORKFLOW_TO_SCOPE]-(:DslPlanDefinition)-[:PLAN_DEFINITION_TO_SITE]-(scopeSite:Site)-[:SITE_TO_SMO]-(:Smo)-[:IS_AN_ORG]-(o)
CALL {
WITH study
OPTIONAL MATCH (study)-[:STUDY_TO_ACTOR]-(a:Actor{delpending:false})-[:FOR_USER]-(u:User),
(a)-[:APPOINTED_AS]-(r:Role)
WHERE r.name IN ["principal_investigator", "study_admin", "regulatory_analyst"]
RETURN collect(DISTINCT CASE WHEN r.name = "principal_investigator" THEN u.tildaid END) AS piTildaid,
collect(DISTINCT CASE WHEN r.name = "study_admin" THEN u.tildaid END) AS smoTildaid,
collect(DISTINCT CASE WHEN r.name = "regulatory_analyst" THEN u.tildaid END) AS raTildaid
}
CALL {
WITH o
OPTIONAL MATCH (o)-[:ORGANIZATION_TO_ACTOR]-(a:Actor{delpending:false})-[:FOR_USER]-(u:User),
(a)-[:APPOINTED_AS]-(:Role{name:"org_admin"})
RETURN collect(DISTINCT u.tildaid) AS adminTildaid
}
CALL {
WITH scopeSite
OPTIONAL MATCH (scopeSite)-[:STAFF_TO_ACTOR]-(a:Actor{delpending:false})-[:FOR_USER]-(u:User),
(a)-[:APPOINTED_AS]-(:Role{name:"site_admin"})
RETURN collect(DISTINCT u.tildaid) AS siteAdminTildaid
}
RETURN DISTINCT t AS task, apoc.convert.toJson({userTildaid: user.tildaid, userName: user.name,
PITildaid: piTildaid, studyOwnerTildaid: smoTildaid, regAnalystTildaid: raTildaid,
orgAdminTildaid: adminTildaid, studyName: study.name, siteName: scopeSite.name,
siteAdminTildaid: siteAdminTildaid}) AS details, tc.who AS dsnWho, o.alias AS orgAlias,
taskInbox, taskUser.tildaid AS taskUserId
SKIP 800 LIMIT 400
raw payload (15 fields)
{
"allocatedBytes": 11025260.0,
"cpu": 40601.0,
"elapsedTimeMs": 41034.0,
"executionPlanCacheKeyHash": "6DF80BFB",
"id": "25350888",
"pageFaults": 0.0,
"pageHits": 76161889.0,
"planning": 1.0,
"query": "\n\t\tMATCH (study:Study )-[:MANAGED_BY]-(:Inbox)-[:BELONGS_TO]-(t:Task)\n\t\tWHERE NOT EXISTS ((t)-[:BELONGS_TO]-(:Inbox{type:\"User\"}))\n\t\tCALL {\n\t\t\tWITH t\n\t\t\tMATCH (t)\u003c-[:CREATED_FROM_SPEC]-(ptc:ParticipantTaskConfig)-[:PARTICIPANT_TASKCONFIG]-(:ParticipantTaskList)-[:PARTICIPANT_TASKLIST]-(:ParticipantControl)-[:PARTICIPANT_CONTROL]-(:ParticipantActivity)-[:PARTICIPANT_ACTIVITY]-(pw:ParticipantWorkflow)\n\t\t\tRETURN ptc, pw\n\t\t\tUNION ALL\n\t\t\tWITH t\n\t\t\tMATCH (t)\u003c-[:CREATED_FROM_SPEC]-(ptc:ParticipantTaskConfig)-[:PARTICIPANT_TASKCONFIG]-(:ParticipantTaskList)-[:PARTICIPANT_TASKLIST]-(:ParticipantActivity)-[:PARTICIPANT_ACTIVITY]-(pw:ParticipantWorkflow)\n\t\t\tRETURN ptc, pw\n\t\t}\n\t\tWITH DISTINCT study, t, ptc, pw\n\t\tMATCH (t)-[:BELONGS_TO]-(:Inbox)-[:MANAGED_BY]-(o:Organization)\n\t\tMATCH (ptc)-[:BELONGS_TO_TASKCONFIG]-(tc:TaskConfig)\n\t\tOPTIONAL MATCH (t)-[:BELONGS_TO]-(taskInbox:Inbox{type:\"User\"})--(taskUser:User)\n\t\tOPTIONAL MATCH (pw)-[:PARTICIPANTWORKFLOW_TO_SCOPE]-(:StudySiteActor)-[:STUDYSITEACTOR_TO_ACTOR]-(:Actor{delpending:false})-[:FOR_USER]-(user:User)\n\t\tOPTIONAL MATCH (pw)-[:PARTICIPANTWORKFLOW_TO_SCOPE]-(:DslPlanDefinition)-[:PLAN_DEFINITION_TO_SITE]-(scopeSite:Site)-[:SITE_TO_SMO]-(:Smo)-[:IS_AN_ORG]-(o)\n\t\tCALL {\n\t\t\tWITH study\n\t\t\tOPTIONAL MATCH (study)-[:STUDY_TO_ACTOR]-(a:Actor{delpending:false})-[:FOR_USER]-(u:User),\n\t\t\t\t(a)-[:APPOINTED_AS]-(r:Role)\n\t\t\tWHERE r.name IN [\"principal_investigator\", \"study_admin\", \"regulatory_analyst\"]\n\t\t\tRETURN collect(DISTINCT CASE WHEN r.name = \"principal_investigator\" THEN u.tildaid END) AS piTildaid,\n\t\t\t\tcollect(DISTINCT CASE WHEN r.name = \"study_admin\" THEN u.tildaid END) AS smoTildaid,\n\t\t\t\tcollect(DISTINCT CASE WHEN r.name = \"regulatory_analyst\" THEN u.tildaid END) AS raTildaid\n\t\t}\n\t\tCALL {\n\t\t\tWITH o\n\t\t\tOPTIONAL MATCH (o)-[:ORGANIZATION_TO_ACTOR]-(a:Actor{delpending:false})-[:FOR_USER]-(u:User),\n\t\t\t\t(a)-[:APPOINTED_AS]-(:Role{name:\"org_admin\"})\n\t\t\tRETURN collect(DISTINCT u.tildaid) AS adminTildaid\n\t\t}\n\t\tCALL {\n\t\t\tWITH scopeSite\n\t\t\tOPTIONAL MATCH (scopeSite)-[:STAFF_TO_ACTOR]-(a:Actor{delpending:false})-[:FOR_USER]-(u:User),\n\t\t\t\t(a)-[:APPOINTED_AS]-(:Role{name:\"site_admin\"})\n\t\t\tRETURN collect(DISTINCT u.tildaid) AS siteAdminTildaid\n\t\t}\n\t\tRETURN DISTINCT t AS task, apoc.convert.toJson({userTildaid: user.tildaid, userName: user.name,\n\t\t\tPITildaid: piTildaid, studyOwnerTildaid: smoTildaid, regAnalystTildaid: raTildaid,\n\t\t\torgAdminTildaid: adminTildaid, studyName: study.name, siteName: scopeSite.name,\n\t\t\tsiteAdminTildaid: siteAdminTildaid}) AS details, tc.who AS dsnWho, o.alias AS orgAlias,\n\t\t\ttaskInbox, taskUser.tildaid AS taskUserId\n\t\tSKIP 800 LIMIT 400",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tGo Driver/5.20.0\t\tclient/10.129.0.236:35900\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:36.510Z",
"transactionId": 12244885.0,
"waiting": 0.0
}14s ago2026-07-27 02:17:35 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:35 UTC
severityINFO
clustermaster
podlitellm-f54655c99-tt2pg
14s ago2026-07-27 02:17:35 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:35 UTC
severityINFO
clustermaster
podrag-agent-57879dd94f-l9nz7
15s ago2026-07-27 02:17:34 UTC DEBUG execsvc Memory statistics
time2026-07-27 02:17:34 UTC
severityDEBUG
serviceexecsvc
sourcemetrics/memory.go:146
clustermaster
versionv1
podexecsvc-5c986994bc-psst2
message
Memory statistics
raw payload (12 fields)
{
"caller": "metrics/memory.go:146",
"cluster": "master",
"environment": "DEVELOPMENT",
"goroutines": 238.0,
"heap_alloc_mb": 9.0,
"message": "Memory statistics",
"msg": "mem_stats",
"num_gc": 473.0,
"service": "execsvc",
"sys_mb": 34.0,
"timestamp": "2026-07-27T02:17:34.612Z",
"version": "v1"
}15s ago2026-07-27 02:17:34 UTC neo4j virtual-assistant RETURN 1 as health_check
time2026-07-27 02:17:34 UTC
severityINFO
servicevirtual-assistant
clustermaster
tracee1a1995b665ace0f335da51fd5d3b944
span94e03ecd9cdc39e4
podserver-2-dev-0
query
RETURN 1 as health_check
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "745CE4BF",
"id": "25358413",
"pageFaults": 0.0,
"pageHits": 0.0,
"planning": 0.0,
"query": "RETURN 1 as health_check",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.201:47754\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:34.236Z",
"transactionId": 12246594.0,
"waiting": 0.0
}15s ago2026-07-27 02:17:34 UTC neo4j virtual-assistant RETURN 1
time2026-07-27 02:17:34 UTC
severityINFO
servicevirtual-assistant
clustermaster
tracee1a1995b665ace0f335da51fd5d3b944
span94e03ecd9cdc39e4
podserver-2-dev-0
query
RETURN 1
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "4CADEF45",
"id": "25358412",
"pageFaults": 0.0,
"pageHits": 0.0,
"planning": 0.0,
"query": "RETURN 1",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.201:47754\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:34.228Z",
"transactionId": 12246593.0,
"waiting": 0.0
}15s ago2026-07-27 02:17:34 UTC DEBUG virtual-assistant Session attributes: ['_auto_result', '_bookmark_manager', '_bookmarks', '_check_state', '_closed', '_config', '_connect', '_connection',...
time2026-07-27 02:17:34 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/neo4j_client.py:850
clustermaster
versionunknown
tracee1a1995b665ace0f335da51fd5d3b944
span94e03ecd9cdc39e4
podvirtual-assistant-65b975d66b-l8wpw
message
Session attributes: ['_auto_result', '_bookmark_manager', '_bookmarks', '_check_state', '_closed', '_config', '_connect', '_connection', '_connection_access_mode', '_disconnect', '_get_bookmarks', '_get_routing_target_database', '_get_server_info', '_handle_cancellation', '_initial_bookmarks', '_initialize_bookmarks', '_last_cache_key', '_last_from_bookmark_manager', '_make_db_resolution_callback', '_non_concurrent_iter', '_non_concurrent_method', '_open_transaction', '_pinned_database', '_pipelined_begin', '_pool', '_resolve_session_auth', '_result_closed', '_result_error', '_run_transaction', '_set_pinned_database', '_state_failed', '_transaction', '_transaction_cancel_handler', '_transaction_closed_handler', '_transaction_error_handler', '_update_bookmark', '_update_bookmarks', '_verify_authentication', 'begin_transaction', 'close', 'closed', 'execute_read', 'execute_write', 'last_bookmark', 'last_bookmarks', 'read_transaction', 'run', 'write_transaction']
raw payload (9 fields)
{
"caller": "src/neo4j_client.py:850",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Session attributes: [\u0027_auto_result\u0027, \u0027_bookmark_manager\u0027, \u0027_bookmarks\u0027, \u0027_check_state\u0027, \u0027_closed\u0027, \u0027_config\u0027, \u0027_connect\u0027, \u0027_connection\u0027, \u0027_connection_access_mode\u0027, \u0027_disconnect\u0027, \u0027_get_bookmarks\u0027, \u0027_get_routing_target_database\u0027, \u0027_get_server_info\u0027, \u0027_handle_cancellation\u0027, \u0027_initial_bookmarks\u0027, \u0027_initialize_bookmarks\u0027, \u0027_last_cache_key\u0027, \u0027_last_from_bookmark_manager\u0027, \u0027_make_db_resolution_callback\u0027, \u0027_non_concurrent_iter\u0027, \u0027_non_concurrent_method\u0027, \u0027_open_transaction\u0027, \u0027_pinned_database\u0027, \u0027_pipelined_begin\u0027, \u0027_pool\u0027, \u0027_resolve_session_auth\u0027, \u0027_result_closed\u0027, \u0027_result_error\u0027, \u0027_run_transaction\u0027, \u0027_set_pinned_database\u0027, \u0027_state_failed\u0027, \u0027_transaction\u0027, \u0027_transaction_cancel_handler\u0027, \u0027_transaction_closed_handler\u0027, \u0027_transaction_error_handler\u0027, \u0027_update_bookmark\u0027, \u0027_update_bookmarks\u0027, \u0027_verify_authentication\u0027, \u0027begin_transaction\u0027, \u0027close\u0027, \u0027closed\u0027, \u0027execute_read\u0027, \u0027execute_write\u0027, \u0027last_bookmark\u0027, \u0027last_bookmarks\u0027, \u0027read_transaction\u0027, \u0027run\u0027, \u0027write_transaction\u0027]",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:34.218Z",
"version": "unknown"
}15s ago2026-07-27 02:17:34 UTC DEBUG virtual-assistant Pool attributes: ['_abc_impl', '_acquire', '_acquire_from_pool', '_acquire_from_pool_checked', '_acquire_new_later', '_add_connections',...
time2026-07-27 02:17:34 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/neo4j_client.py:796
clustermaster
versionunknown
tracee1a1995b665ace0f335da51fd5d3b944
span94e03ecd9cdc39e4
podvirtual-assistant-65b975d66b-l8wpw
message
Pool attributes: ['_abc_impl', '_acquire', '_acquire_from_pool', '_acquire_from_pool_checked', '_acquire_new_later', '_add_connections', '_close_connections', '_re_auth_connection', '_remove_connection', '_remove_connections', '_select_address', '_ssr_feature_tracker', '_update_routing_table_from', 'acquire', 'address', 'close', 'cond', 'connections', 'connections_reservations', 'deactivate', 'ensure_routing_table_is_fresh', 'fetch_routing_info', 'fetch_routing_table', 'get_auth', 'get_or_create_routing_table', 'get_routing_table', 'home_db_cache', 'in_use_connection_count', 'is_direct_pool', 'kill_and_release', 'lock', 'mark_all_stale', 'on_neo4j_error', 'on_write_failure', 'open', 'opener', 'pool_config', 'refresh_lock', 'release', 'routing_tables', 'ssr_enabled', 'update_connection_pool', 'update_routing_table', 'workspace_config']
raw payload (9 fields)
{
"caller": "src/neo4j_client.py:796",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Pool attributes: [\u0027_abc_impl\u0027, \u0027_acquire\u0027, \u0027_acquire_from_pool\u0027, \u0027_acquire_from_pool_checked\u0027, \u0027_acquire_new_later\u0027, \u0027_add_connections\u0027, \u0027_close_connections\u0027, \u0027_re_auth_connection\u0027, \u0027_remove_connection\u0027, \u0027_remove_connections\u0027, \u0027_select_address\u0027, \u0027_ssr_feature_tracker\u0027, \u0027_update_routing_table_from\u0027, \u0027acquire\u0027, \u0027address\u0027, \u0027close\u0027, \u0027cond\u0027, \u0027connections\u0027, \u0027connections_reservations\u0027, \u0027deactivate\u0027, \u0027ensure_routing_table_is_fresh\u0027, \u0027fetch_routing_info\u0027, \u0027fetch_routing_table\u0027, \u0027get_auth\u0027, \u0027get_or_create_routing_table\u0027, \u0027get_routing_table\u0027, \u0027home_db_cache\u0027, \u0027in_use_connection_count\u0027, \u0027is_direct_pool\u0027, \u0027kill_and_release\u0027, \u0027lock\u0027, \u0027mark_all_stale\u0027, \u0027on_neo4j_error\u0027, \u0027on_write_failure\u0027, \u0027open\u0027, \u0027opener\u0027, \u0027pool_config\u0027, \u0027refresh_lock\u0027, \u0027release\u0027, \u0027routing_tables\u0027, \u0027ssr_enabled\u0027, \u0027update_connection_pool\u0027, \u0027update_routing_table\u0027, \u0027workspace_config\u0027]",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:34.218Z",
"version": "unknown"
}15s ago2026-07-27 02:17:34 UTC DEBUG virtual-assistant Driver attributes: ['_check_state', '_closed', '_default_workspace_config', '_get_server_info', '_initial_addresses', '_pool',...
time2026-07-27 02:17:34 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/neo4j_client.py:787
clustermaster
versionunknown
tracee1a1995b665ace0f335da51fd5d3b944
span94e03ecd9cdc39e4
podvirtual-assistant-65b975d66b-l8wpw
message
Driver attributes: ['_check_state', '_closed', '_default_workspace_config', '_get_server_info', '_initial_addresses', '_pool', '_prepare_session_config', '_query_bookmark_manager', '_read_session_config', '_session', 'close', 'default_host', 'default_port', 'default_targets', 'encrypted', 'execute_query', 'execute_query_bookmark_manager', 'get_server_info', 'initial_addresses', 'open', 'parse_targets', 'session', 'supports_multi_db', 'supports_session_auth', 'verify_authentication', 'verify_connectivity']
raw payload (9 fields)
{
"caller": "src/neo4j_client.py:787",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Driver attributes: [\u0027_check_state\u0027, \u0027_closed\u0027, \u0027_default_workspace_config\u0027, \u0027_get_server_info\u0027, \u0027_initial_addresses\u0027, \u0027_pool\u0027, \u0027_prepare_session_config\u0027, \u0027_query_bookmark_manager\u0027, \u0027_read_session_config\u0027, \u0027_session\u0027, \u0027close\u0027, \u0027default_host\u0027, \u0027default_port\u0027, \u0027default_targets\u0027, \u0027encrypted\u0027, \u0027execute_query\u0027, \u0027execute_query_bookmark_manager\u0027, \u0027get_server_info\u0027, \u0027initial_addresses\u0027, \u0027open\u0027, \u0027parse_targets\u0027, \u0027session\u0027, \u0027supports_multi_db\u0027, \u0027supports_session_auth\u0027, \u0027verify_authentication\u0027, \u0027verify_connectivity\u0027]",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:34.217Z",
"version": "unknown"
}15s ago2026-07-27 02:17:34 UTC DEBUG virtual-assistant 🔍 AUTH_DEBUG: Path in UNPROTECTED_ENDPOINTS: True
time2026-07-27 02:17:34 UTC
severityDEBUG
servicevirtual-assistant
sourceapi/api.py:491
clustermaster
versionunknown
tracee1a1995b665ace0f335da51fd5d3b944
span94e03ecd9cdc39e4
podvirtual-assistant-65b975d66b-l8wpw
message
🔍 AUTH_DEBUG: Path in UNPROTECTED_ENDPOINTS: True
raw payload (9 fields)
{
"caller": "api/api.py:491",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\ud83d\udd0d AUTH_DEBUG: Path in UNPROTECTED_ENDPOINTS: True",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:34.214Z",
"version": "unknown"
}15s ago2026-07-27 02:17:34 UTC DEBUG virtual-assistant 🔍 AUTH_DEBUG: Method: GET
time2026-07-27 02:17:34 UTC
severityDEBUG
servicevirtual-assistant
sourceapi/api.py:489
clustermaster
versionunknown
tracee1a1995b665ace0f335da51fd5d3b944
span94e03ecd9cdc39e4
podvirtual-assistant-65b975d66b-l8wpw
message
🔍 AUTH_DEBUG: Method: GET
raw payload (9 fields)
{
"caller": "api/api.py:489",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\ud83d\udd0d AUTH_DEBUG: Method: GET",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:34.214Z",
"version": "unknown"
}16s ago2026-07-27 02:17:33 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:33 UTC
severityERROR
clustermaster
podadvpsvc-66c87987bc-6vk8q
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
17s ago2026-07-27 02:17:32 UTC neo4j advpsvc match(a:AdvRateRule{deleted:true})-[r]-(b) with distinct a return a.portalorgid, a.tildaid, a.ruletype limit 10
time2026-07-27 02:17:32 UTC
severityINFO
serviceadvpsvc
clustermaster
podserver-3-dev-0
query
match(a:AdvRateRule{deleted:true})-[r]-(b)
with distinct a
return a.portalorgid, a.tildaid, a.ruletype
limit 10
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 2.0,
"elapsedTimeMs": 2.0,
"executionPlanCacheKeyHash": "AFAFBFFB",
"id": "13641195",
"pageFaults": 0.0,
"pageHits": 1146.0,
"planning": 0.0,
"query": "match(a:AdvRateRule{deleted:true})-[r]-(b) with distinct a return a.portalorgid, a.tildaid, a.ruletype limit 10",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:32.185Z",
"transactionId": 1756246.0,
"waiting": 0.0
}17s ago2026-07-27 02:17:32 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:32 UTC
severityERROR
clustermaster
podexecsvc-5c986994bc-psst2
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
19s ago2026-07-27 02:17:30 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:30 UTC
severityERROR
clustermaster
podtusker-858b678c65-hsvqd
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
19s ago2026-07-27 02:17:30 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:30 UTC
severityERROR
clustermaster
podnotifsvc-8c4bdf758-8kx6b
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
19s ago2026-07-27 02:17:30 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:30 UTC
severityINFO
clustermaster
podrag-agent-57879dd94f-l9nz7
19s ago2026-07-27 02:17:30 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:30 UTC
severityINFO
clustermaster
podlitellm-f54655c99-tt2pg
19s ago2026-07-27 02:17:30 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:30 UTC
severityERROR
clustermaster
podfinsvc-7cb7dbf559-dsqxb
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
19s ago2026-07-27 02:17:30 UTC DEBUG docproc Pulling messages
time2026-07-27 02:17:30 UTC
severityDEBUG
servicedocproc
sourcehandlers/pubsub_handler.py:240
clustermaster
version0.1.0
poddocproc-7bc76669-ljh8h
message
Pulling messages
raw payload (11 fields)
{
"caller": "handlers/pubsub_handler.py:240",
"cluster": "master",
"component": "pubsub",
"environment": "DEVELOPMENT",
"max_messages": 1.0,
"message": "Pulling messages",
"pull_timeout_s": 60.0,
"service": "docproc",
"subscription_name": "tilda-document-master-docproc-sub",
"timestamp": "2026-07-27T02:17:30.413Z",
"version": "0.1.0"
}20s ago2026-07-27 02:17:29 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:29 UTC
severityINFO
clustermaster
podrag-agent-57879dd94f-l9nz7
20s ago2026-07-27 02:17:29 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:29 UTC
severityINFO
clustermaster
podlitellm-f54655c99-tt2pg
20s ago2026-07-27 02:17:29 UTC DEBUG docproc Pull returned 0 messages
time2026-07-27 02:17:29 UTC
severityDEBUG
servicedocproc
sourcehandlers/pubsub_handler.py:284
clustermaster
version0.1.0
poddocproc-7bc76669-ljh8h
message
Pull returned 0 messages
raw payload (9 fields)
{
"caller": "handlers/pubsub_handler.py:284",
"cluster": "master",
"component": "pubsub",
"environment": "DEVELOPMENT",
"message": "Pull returned 0 messages",
"service": "docproc",
"subscription_name": "tilda-document-master-docproc-sub",
"timestamp": "2026-07-27T02:17:29.410Z",
"version": "0.1.0"
}20s ago2026-07-27 02:17:29 UTC DEBUG docproc Recovery fill
time2026-07-27 02:17:29 UTC
severityDEBUG
servicedocproc
sourcehandlers/pubsub_handler.py:429
clustermaster
version0.1.0
poddocproc-7bc76669-ljh8h
message
Recovery fill
raw payload (13 fields)
{
"adopt_list_len": 0.0,
"adopt_started": 0.0,
"backlog_list_len": 0.0,
"backlog_started": 0.0,
"caller": "handlers/pubsub_handler.py:429",
"cluster": "master",
"component": "pubsub",
"environment": "DEVELOPMENT",
"message": "Recovery fill",
"remaining_slots": 10.0,
"service": "docproc",
"timestamp": "2026-07-27T02:17:29.410Z",
"version": "0.1.0"
}20s ago2026-07-27 02:17:29 UTC neo4j docproc MATCH (o:Organization{orgType:"CRO"})-[:DOC_TO_ORG]-(d:Document)-[:INCLUDES]-(f:Folder) WHERE f.name IN ['Staging', 'Pre-Staging'] ...
time2026-07-27 02:17:29 UTC
severityINFO
servicedocproc
clustermaster
podserver-2-dev-0
query
MATCH (o:Organization{orgType:"CRO"})-[:DOC_TO_ORG]-(d:Document)-[:INCLUDES]-(f:Folder)
WHERE f.name IN ['Staging', 'Pre-Staging']
AND d.delpending = false AND d.aiEnabled = true AND d.studyId <> ""
AND d.primaryVersionId IS NOT NULL AND d.primaryVersionId <> ""
OPTIONAL MATCH (d)<-[:AI_RUN_TO_DOCUMENT_LATEST]-(ai:AIRun)
WITH o, d, ai
ORDER BY d.tildaid, COALESCE(ai.updatedat, ai.createdat) DESC
WITH o, d, collect(ai)[0] AS latest_ai
WHERE (
latest_ai IS NULL
OR latest_ai.status = "aborted"
OR (
latest_ai.status = "failed"
AND COALESCE(latest_ai.auto_retry_count, 0) < $max_retries
AND COALESCE(latest_ai.updatedat, latest_ai.createdat) < $threshold_ms
)
)
WITH d.tildaid AS doc_id, o.alias AS org_alias, d.primaryVersionId AS version_id,
d.studyId AS study_id, COALESCE(latest_ai.auto_retry_count, 0) AS current_retry_count
RETURN doc_id, org_alias, version_id, study_id, current_retry_count
ORDER BY doc_id
LIMIT $limit
raw payload (15 fields)
{
"allocatedBytes": 9610664.0,
"cpu": 173.0,
"elapsedTimeMs": 174.0,
"executionPlanCacheKeyHash": "7644B06C",
"id": "25357811",
"pageFaults": 0.0,
"pageHits": 156362.0,
"planning": 0.0,
"query": "\n MATCH (o:Organization{orgType:\"CRO\"})-[:DOC_TO_ORG]-(d:Document)-[:INCLUDES]-(f:Folder)\n WHERE f.name IN [\u0027Staging\u0027, \u0027Pre-Staging\u0027]\n AND d.delpending = false AND d.aiEnabled = true AND d.studyId \u003c\u003e \"\"\n AND d.primaryVersionId IS NOT NULL AND d.primaryVersionId \u003c\u003e \"\"\n OPTIONAL MATCH (d)\u003c-[:AI_RUN_TO_DOCUMENT_LATEST]-(ai:AIRun)\n WITH o, d, ai\n ORDER BY d.tildaid, COALESCE(ai.updatedat, ai.createdat) DESC\n WITH o, d, collect(ai)[0] AS latest_ai\n WHERE (\n latest_ai IS NULL\n OR latest_ai.status = \"aborted\"\n OR (\n latest_ai.status = \"failed\"\n AND COALESCE(latest_ai.auto_retry_count, 0) \u003c $max_retries\n AND COALESCE(latest_ai.updatedat, latest_ai.createdat) \u003c $threshold_ms\n )\n )\n WITH d.tildaid AS doc_id, o.alias AS org_alias, d.primaryVersionId AS version_id,\n d.studyId AS study_id, COALESCE(latest_ai.auto_retry_count, 0) AS current_retry_count\n RETURN doc_id, org_alias, version_id, study_id, current_retry_count\n ORDER BY doc_id\n LIMIT $limit\n ",
"queryParameters": "{limit: 10, max_retries: 5, threshold_ms: 1785117749227}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.2.71:49876\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:29.406Z",
"transactionId": 12246590.0,
"waiting": 0.0
}20s ago2026-07-27 02:17:29 UTC neo4j docproc MATCH (ai:AIRun)-[:AI_RUN_TO_DOCUMENT_LATEST]->(d:Document) WHERE d.aiEnabled = true AND ( (ai.status = "in_progress" AND...
time2026-07-27 02:17:29 UTC
severityINFO
servicedocproc
clustermaster
podserver-2-dev-0
query
MATCH (ai:AIRun)-[:AI_RUN_TO_DOCUMENT_LATEST]->(d:Document)
WHERE d.aiEnabled = true
AND (
(ai.status = "in_progress" AND ($cutoff_ms <= 0 OR COALESCE(ai.updatedat, ai.createdat) < $cutoff_ms))
OR ai.status = "aborted"
)
MATCH (d)-[:DOC_TO_ORG]->(o:Organization)
RETURN d.tildaid AS document_id, d.primaryVersionId AS version_id,
ai.tildaid AS ai_run_id, d.studyId AS study_id, ai.run_type AS run_type,
o.tildaid AS org_id, o.alias AS org_alias
ORDER BY COALESCE(ai.updatedat, ai.createdat) ASC
LIMIT $limit
raw payload (15 fields)
{
"allocatedBytes": 736.0,
"cpu": 109.0,
"elapsedTimeMs": 109.0,
"executionPlanCacheKeyHash": "E5FA14C6",
"id": "25357794",
"pageFaults": 0.0,
"pageHits": 89927.0,
"planning": 0.0,
"query": "\n MATCH (ai:AIRun)-[:AI_RUN_TO_DOCUMENT_LATEST]-\u003e(d:Document)\n WHERE d.aiEnabled = true\n AND (\n (ai.status = \"in_progress\" AND ($cutoff_ms \u003c= 0 OR COALESCE(ai.updatedat, ai.createdat) \u003c $cutoff_ms))\n OR ai.status = \"aborted\"\n )\n MATCH (d)-[:DOC_TO_ORG]-\u003e(o:Organization)\n RETURN d.tildaid AS document_id, d.primaryVersionId AS version_id,\n ai.tildaid AS ai_run_id, d.studyId AS study_id, ai.run_type AS run_type,\n o.tildaid AS org_id, o.alias AS org_alias\n ORDER BY COALESCE(ai.updatedat, ai.createdat) ASC\n LIMIT $limit\n ",
"queryParameters": "{limit: 30, cutoff_ms: 1785118049108}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.2.71:49876\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:29.223Z",
"transactionId": 12246589.0,
"waiting": 0.0
}22s ago2026-07-27 02:17:27 UTC DEBUG docproc Reported pending workload
time2026-07-27 02:17:27 UTC
severityDEBUG
servicedocproc
sourcejobs/hpa_pending_workload.py:176
clustermaster
version0.1.0
poddocproc-7bc76669-ljh8h
message
Reported pending workload
raw payload (15 fields)
{
"backlog_capped": 0.0,
"caller": "jobs/hpa_pending_workload.py:176",
"cluster": "master",
"component": "hpa_pending_workload",
"environment": "DEVELOPMENT",
"in_progress_count": 0.0,
"message": "Reported pending workload",
"num_replicas": 1.0,
"recovery_workload": 0.0,
"service": "docproc",
"signal": 0.0,
"timestamp": "2026-07-27T02:17:27.352Z",
"total_workload": 0.0,
"unacked": 0.0,
"version": "0.1.0"
}22s ago2026-07-27 02:17:27 UTC DEBUG docproc Pub/Sub num_unacked result: project_id=tilda-trial-automation subscription_id_in_filter=tilda-document-master-docproc-sub num_series=1 total=0
time2026-07-27 02:17:27 UTC
severityDEBUG
servicedocproc
sourcejobs/cloud_monitoring_metrics.py:296
clustermaster
version0.1.0
poddocproc-7bc76669-ljh8h
message
Pub/Sub num_unacked result: project_id=tilda-trial-automation subscription_id_in_filter=tilda-document-master-docproc-sub num_series=1 total=0
raw payload (7 fields)
{
"caller": "jobs/cloud_monitoring_metrics.py:296",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Pub/Sub num_unacked result: project_id=tilda-trial-automation subscription_id_in_filter=tilda-document-master-docproc-sub num_series=1 total=0",
"service": "docproc",
"timestamp": "2026-07-27T02:17:27.265Z",
"version": "0.1.0"
}22s ago2026-07-27 02:17:27 UTC neo4j advpsvc match(a:AdvRateRule{deleted:true})-[r]-(b) with distinct a return a.portalorgid, a.tildaid, a.ruletype limit 10
time2026-07-27 02:17:27 UTC
severityINFO
serviceadvpsvc
clustermaster
podserver-1-dev-0
query
match(a:AdvRateRule{deleted:true})-[r]-(b)
with distinct a
return a.portalorgid, a.tildaid, a.ruletype
limit 10
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 2.0,
"elapsedTimeMs": 2.0,
"executionPlanCacheKeyHash": "AFAFBFFB",
"id": "17603404",
"pageFaults": 0.0,
"pageHits": 1146.0,
"planning": 0.0,
"query": "match(a:AdvRateRule{deleted:true})-[r]-(b) with distinct a return a.portalorgid, a.tildaid, a.ruletype limit 10",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:27.171Z",
"transactionId": 1776282.0,
"waiting": 0.0
}22s ago2026-07-27 02:17:27 UTC neo4j docproc MATCH (o:Organization{orgType:"CRO"})-[:DOC_TO_ORG]-(d:Document)-[:INCLUDES]-(f:Folder) WHERE f.name IN ['Staging', 'Pre-Staging'] ...
time2026-07-27 02:17:27 UTC
severityINFO
servicedocproc
clustermaster
podserver-2-dev-0
query
MATCH (o:Organization{orgType:"CRO"})-[:DOC_TO_ORG]-(d:Document)-[:INCLUDES]-(f:Folder)
WHERE f.name IN ['Staging', 'Pre-Staging']
AND d.delpending = false AND d.aiEnabled = true AND d.studyId <> ""
AND d.primaryVersionId IS NOT NULL AND d.primaryVersionId <> ""
OPTIONAL MATCH (d)<-[:AI_RUN_TO_DOCUMENT_LATEST]-(ai:AIRun)
WITH o, d, ai
ORDER BY d.tildaid, COALESCE(ai.updatedat, ai.createdat) DESC
WITH o, d, collect(ai)[0] AS latest_ai
WHERE (
latest_ai IS NULL
OR latest_ai.status = "aborted"
OR (
latest_ai.status = "failed"
AND COALESCE(latest_ai.auto_retry_count, 0) < $max_retries
AND COALESCE(latest_ai.updatedat, latest_ai.createdat) < $threshold_ms
)
)
WITH d
RETURN count(d) AS total
raw payload (15 fields)
{
"allocatedBytes": 7666360.0,
"cpu": 165.0,
"elapsedTimeMs": 165.0,
"executionPlanCacheKeyHash": "590286C5",
"id": "25357596",
"pageFaults": 0.0,
"pageHits": 156362.0,
"planning": 0.0,
"query": "\n MATCH (o:Organization{orgType:\"CRO\"})-[:DOC_TO_ORG]-(d:Document)-[:INCLUDES]-(f:Folder)\n WHERE f.name IN [\u0027Staging\u0027, \u0027Pre-Staging\u0027]\n AND d.delpending = false AND d.aiEnabled = true AND d.studyId \u003c\u003e \"\"\n AND d.primaryVersionId IS NOT NULL AND d.primaryVersionId \u003c\u003e \"\"\n OPTIONAL MATCH (d)\u003c-[:AI_RUN_TO_DOCUMENT_LATEST]-(ai:AIRun)\n WITH o, d, ai\n ORDER BY d.tildaid, COALESCE(ai.updatedat, ai.createdat) DESC\n WITH o, d, collect(ai)[0] AS latest_ai\n WHERE (\n latest_ai IS NULL\n OR latest_ai.status = \"aborted\"\n OR (\n latest_ai.status = \"failed\"\n AND COALESCE(latest_ai.auto_retry_count, 0) \u003c $max_retries\n AND COALESCE(latest_ai.updatedat, latest_ai.createdat) \u003c $threshold_ms\n )\n )\n WITH d\n RETURN count(d) AS total\n ",
"queryParameters": "{max_retries: 5, threshold_ms: 1785117746877}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.2.71:49876\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:27.051Z",
"transactionId": 12246588.0,
"waiting": 0.0
}23s ago2026-07-27 02:17:26 UTC neo4j docproc MATCH (ai:AIRun)-[:AI_RUN_TO_DOCUMENT_LATEST]->(d:Document) WHERE d.aiEnabled = true AND ( (ai.status = "in_progress" AND...
time2026-07-27 02:17:26 UTC
severityINFO
servicedocproc
clustermaster
podserver-2-dev-0
query
MATCH (ai:AIRun)-[:AI_RUN_TO_DOCUMENT_LATEST]->(d:Document)
WHERE d.aiEnabled = true
AND (
(ai.status = "in_progress" AND ($cutoff_ms <= 0 OR COALESCE(ai.updatedat, ai.createdat) < $cutoff_ms))
OR ai.status = "aborted"
)
RETURN count(ai) AS total
raw payload (15 fields)
{
"allocatedBytes": 488.0,
"cpu": 67.0,
"elapsedTimeMs": 67.0,
"executionPlanCacheKeyHash": "E4907905",
"id": "25357583",
"pageFaults": 0.0,
"pageHits": 66825.0,
"planning": 0.0,
"query": "\n MATCH (ai:AIRun)-[:AI_RUN_TO_DOCUMENT_LATEST]-\u003e(d:Document)\n WHERE d.aiEnabled = true\n AND (\n (ai.status = \"in_progress\" AND ($cutoff_ms \u003c= 0 OR COALESCE(ai.updatedat, ai.createdat) \u003c $cutoff_ms))\n OR ai.status = \"aborted\"\n )\n RETURN count(ai) AS total\n ",
"queryParameters": "{cutoff_ms: 0}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.2.71:49876\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:26.872Z",
"transactionId": 12246587.0,
"waiting": 0.0
}23s ago2026-07-27 02:17:26 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:26 UTC
severityERROR
clustermaster
podonboardingsvc-f7f5bf697-xrcmm
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
24s ago2026-07-27 02:17:25 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:25 UTC
severityINFO
clustermaster
podrag-agent-57879dd94f-l9nz7
24s ago2026-07-27 02:17:25 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:25 UTC
severityINFO
clustermaster
podlitellm-f54655c99-tt2pg
24s ago2026-07-27 02:17:25 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:25 UTC
severityERROR
clustermaster
poddashrsvc-5d5d9b97d8-69bw8
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
25s ago2026-07-27 02:17:24 UTC neo4j virtual-assistant RETURN 1 as health_check
time2026-07-27 02:17:24 UTC
severityINFO
servicevirtual-assistant
clustermaster
trace427a5460b5a02d8f725e433658127a68
span3bd42911f3e113a8
podserver-2-dev-0
query
RETURN 1 as health_check
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "745CE4BF",
"id": "25357357",
"pageFaults": 0.0,
"pageHits": 0.0,
"planning": 0.0,
"query": "RETURN 1 as health_check",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.201:47754\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:24.232Z",
"transactionId": 12246585.0,
"waiting": 0.0
}25s ago2026-07-27 02:17:24 UTC neo4j virtual-assistant RETURN 1
time2026-07-27 02:17:24 UTC
severityINFO
servicevirtual-assistant
clustermaster
trace427a5460b5a02d8f725e433658127a68
span3bd42911f3e113a8
podserver-2-dev-0
query
RETURN 1
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "4CADEF45",
"id": "25357355",
"pageFaults": 0.0,
"pageHits": 0.0,
"planning": 0.0,
"query": "RETURN 1",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.201:47754\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:24.224Z",
"transactionId": 12246584.0,
"waiting": 0.0
}25s ago2026-07-27 02:17:24 UTC DEBUG virtual-assistant Session attributes: ['_auto_result', '_bookmark_manager', '_bookmarks', '_check_state', '_closed', '_config', '_connect', '_connection',...
time2026-07-27 02:17:24 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/neo4j_client.py:850
clustermaster
versionunknown
trace427a5460b5a02d8f725e433658127a68
span3bd42911f3e113a8
podvirtual-assistant-65b975d66b-l8wpw
message
Session attributes: ['_auto_result', '_bookmark_manager', '_bookmarks', '_check_state', '_closed', '_config', '_connect', '_connection', '_connection_access_mode', '_disconnect', '_get_bookmarks', '_get_routing_target_database', '_get_server_info', '_handle_cancellation', '_initial_bookmarks', '_initialize_bookmarks', '_last_cache_key', '_last_from_bookmark_manager', '_make_db_resolution_callback', '_non_concurrent_iter', '_non_concurrent_method', '_open_transaction', '_pinned_database', '_pipelined_begin', '_pool', '_resolve_session_auth', '_result_closed', '_result_error', '_run_transaction', '_set_pinned_database', '_state_failed', '_transaction', '_transaction_cancel_handler', '_transaction_closed_handler', '_transaction_error_handler', '_update_bookmark', '_update_bookmarks', '_verify_authentication', 'begin_transaction', 'close', 'closed', 'execute_read', 'execute_write', 'last_bookmark', 'last_bookmarks', 'read_transaction', 'run', 'write_transaction']
raw payload (9 fields)
{
"caller": "src/neo4j_client.py:850",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Session attributes: [\u0027_auto_result\u0027, \u0027_bookmark_manager\u0027, \u0027_bookmarks\u0027, \u0027_check_state\u0027, \u0027_closed\u0027, \u0027_config\u0027, \u0027_connect\u0027, \u0027_connection\u0027, \u0027_connection_access_mode\u0027, \u0027_disconnect\u0027, \u0027_get_bookmarks\u0027, \u0027_get_routing_target_database\u0027, \u0027_get_server_info\u0027, \u0027_handle_cancellation\u0027, \u0027_initial_bookmarks\u0027, \u0027_initialize_bookmarks\u0027, \u0027_last_cache_key\u0027, \u0027_last_from_bookmark_manager\u0027, \u0027_make_db_resolution_callback\u0027, \u0027_non_concurrent_iter\u0027, \u0027_non_concurrent_method\u0027, \u0027_open_transaction\u0027, \u0027_pinned_database\u0027, \u0027_pipelined_begin\u0027, \u0027_pool\u0027, \u0027_resolve_session_auth\u0027, \u0027_result_closed\u0027, \u0027_result_error\u0027, \u0027_run_transaction\u0027, \u0027_set_pinned_database\u0027, \u0027_state_failed\u0027, \u0027_transaction\u0027, \u0027_transaction_cancel_handler\u0027, \u0027_transaction_closed_handler\u0027, \u0027_transaction_error_handler\u0027, \u0027_update_bookmark\u0027, \u0027_update_bookmarks\u0027, \u0027_verify_authentication\u0027, \u0027begin_transaction\u0027, \u0027close\u0027, \u0027closed\u0027, \u0027execute_read\u0027, \u0027execute_write\u0027, \u0027last_bookmark\u0027, \u0027last_bookmarks\u0027, \u0027read_transaction\u0027, \u0027run\u0027, \u0027write_transaction\u0027]",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:24.218Z",
"version": "unknown"
}25s ago2026-07-27 02:17:24 UTC DEBUG virtual-assistant Pool attributes: ['_abc_impl', '_acquire', '_acquire_from_pool', '_acquire_from_pool_checked', '_acquire_new_later', '_add_connections',...
time2026-07-27 02:17:24 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/neo4j_client.py:796
clustermaster
versionunknown
trace427a5460b5a02d8f725e433658127a68
span3bd42911f3e113a8
podvirtual-assistant-65b975d66b-l8wpw
message
Pool attributes: ['_abc_impl', '_acquire', '_acquire_from_pool', '_acquire_from_pool_checked', '_acquire_new_later', '_add_connections', '_close_connections', '_re_auth_connection', '_remove_connection', '_remove_connections', '_select_address', '_ssr_feature_tracker', '_update_routing_table_from', 'acquire', 'address', 'close', 'cond', 'connections', 'connections_reservations', 'deactivate', 'ensure_routing_table_is_fresh', 'fetch_routing_info', 'fetch_routing_table', 'get_auth', 'get_or_create_routing_table', 'get_routing_table', 'home_db_cache', 'in_use_connection_count', 'is_direct_pool', 'kill_and_release', 'lock', 'mark_all_stale', 'on_neo4j_error', 'on_write_failure', 'open', 'opener', 'pool_config', 'refresh_lock', 'release', 'routing_tables', 'ssr_enabled', 'update_connection_pool', 'update_routing_table', 'workspace_config']
raw payload (9 fields)
{
"caller": "src/neo4j_client.py:796",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Pool attributes: [\u0027_abc_impl\u0027, \u0027_acquire\u0027, \u0027_acquire_from_pool\u0027, \u0027_acquire_from_pool_checked\u0027, \u0027_acquire_new_later\u0027, \u0027_add_connections\u0027, \u0027_close_connections\u0027, \u0027_re_auth_connection\u0027, \u0027_remove_connection\u0027, \u0027_remove_connections\u0027, \u0027_select_address\u0027, \u0027_ssr_feature_tracker\u0027, \u0027_update_routing_table_from\u0027, \u0027acquire\u0027, \u0027address\u0027, \u0027close\u0027, \u0027cond\u0027, \u0027connections\u0027, \u0027connections_reservations\u0027, \u0027deactivate\u0027, \u0027ensure_routing_table_is_fresh\u0027, \u0027fetch_routing_info\u0027, \u0027fetch_routing_table\u0027, \u0027get_auth\u0027, \u0027get_or_create_routing_table\u0027, \u0027get_routing_table\u0027, \u0027home_db_cache\u0027, \u0027in_use_connection_count\u0027, \u0027is_direct_pool\u0027, \u0027kill_and_release\u0027, \u0027lock\u0027, \u0027mark_all_stale\u0027, \u0027on_neo4j_error\u0027, \u0027on_write_failure\u0027, \u0027open\u0027, \u0027opener\u0027, \u0027pool_config\u0027, \u0027refresh_lock\u0027, \u0027release\u0027, \u0027routing_tables\u0027, \u0027ssr_enabled\u0027, \u0027update_connection_pool\u0027, \u0027update_routing_table\u0027, \u0027workspace_config\u0027]",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:24.218Z",
"version": "unknown"
}25s ago2026-07-27 02:17:24 UTC DEBUG virtual-assistant Driver attributes: ['_check_state', '_closed', '_default_workspace_config', '_get_server_info', '_initial_addresses', '_pool',...
time2026-07-27 02:17:24 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/neo4j_client.py:787
clustermaster
versionunknown
trace427a5460b5a02d8f725e433658127a68
span3bd42911f3e113a8
podvirtual-assistant-65b975d66b-l8wpw
message
Driver attributes: ['_check_state', '_closed', '_default_workspace_config', '_get_server_info', '_initial_addresses', '_pool', '_prepare_session_config', '_query_bookmark_manager', '_read_session_config', '_session', 'close', 'default_host', 'default_port', 'default_targets', 'encrypted', 'execute_query', 'execute_query_bookmark_manager', 'get_server_info', 'initial_addresses', 'open', 'parse_targets', 'session', 'supports_multi_db', 'supports_session_auth', 'verify_authentication', 'verify_connectivity']
raw payload (9 fields)
{
"caller": "src/neo4j_client.py:787",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Driver attributes: [\u0027_check_state\u0027, \u0027_closed\u0027, \u0027_default_workspace_config\u0027, \u0027_get_server_info\u0027, \u0027_initial_addresses\u0027, \u0027_pool\u0027, \u0027_prepare_session_config\u0027, \u0027_query_bookmark_manager\u0027, \u0027_read_session_config\u0027, \u0027_session\u0027, \u0027close\u0027, \u0027default_host\u0027, \u0027default_port\u0027, \u0027default_targets\u0027, \u0027encrypted\u0027, \u0027execute_query\u0027, \u0027execute_query_bookmark_manager\u0027, \u0027get_server_info\u0027, \u0027initial_addresses\u0027, \u0027open\u0027, \u0027parse_targets\u0027, \u0027session\u0027, \u0027supports_multi_db\u0027, \u0027supports_session_auth\u0027, \u0027verify_authentication\u0027, \u0027verify_connectivity\u0027]",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:24.217Z",
"version": "unknown"
}25s ago2026-07-27 02:17:24 UTC DEBUG virtual-assistant 🔍 AUTH_DEBUG: Path in UNPROTECTED_ENDPOINTS: True
time2026-07-27 02:17:24 UTC
severityDEBUG
servicevirtual-assistant
sourceapi/api.py:491
clustermaster
versionunknown
trace427a5460b5a02d8f725e433658127a68
span3bd42911f3e113a8
podvirtual-assistant-65b975d66b-l8wpw
message
🔍 AUTH_DEBUG: Path in UNPROTECTED_ENDPOINTS: True
raw payload (9 fields)
{
"caller": "api/api.py:491",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\ud83d\udd0d AUTH_DEBUG: Path in UNPROTECTED_ENDPOINTS: True",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:24.214Z",
"version": "unknown"
}25s ago2026-07-27 02:17:24 UTC DEBUG virtual-assistant 🔍 AUTH_DEBUG: Method: GET
time2026-07-27 02:17:24 UTC
severityDEBUG
servicevirtual-assistant
sourceapi/api.py:489
clustermaster
versionunknown
trace427a5460b5a02d8f725e433658127a68
span3bd42911f3e113a8
podvirtual-assistant-65b975d66b-l8wpw
message
🔍 AUTH_DEBUG: Method: GET
raw payload (9 fields)
{
"caller": "api/api.py:489",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\ud83d\udd0d AUTH_DEBUG: Method: GET",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:24.213Z",
"version": "unknown"
}25s ago2026-07-27 02:17:24 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:24 UTC
severityERROR
clustermaster
podpatientsvc-9975d5469-pl5lt
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
25s ago2026-07-27 02:17:24 UTC neo4j virtual-assistant RETURN 1 as health_check
time2026-07-27 02:17:24 UTC
severityINFO
servicevirtual-assistant
clustermaster
trace1d4bc72280647cedd4b5e39e57d92618
span4b8f923a7f83aec4
podserver-2-dev-0
query
RETURN 1 as health_check
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "745CE4BF",
"id": "25357348",
"pageFaults": 0.0,
"pageHits": 0.0,
"planning": 0.0,
"query": "RETURN 1 as health_check",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.201:47754\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:24.131Z",
"transactionId": 12246583.0,
"waiting": 0.0
}25s ago2026-07-27 02:17:24 UTC neo4j virtual-assistant RETURN 1
time2026-07-27 02:17:24 UTC
severityINFO
servicevirtual-assistant
clustermaster
trace1d4bc72280647cedd4b5e39e57d92618
span4b8f923a7f83aec4
podserver-2-dev-0
query
RETURN 1
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "4CADEF45",
"id": "25357346",
"pageFaults": 0.0,
"pageHits": 0.0,
"planning": 0.0,
"query": "RETURN 1",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.201:47754\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:24.123Z",
"transactionId": 12246582.0,
"waiting": 0.0
}25s ago2026-07-27 02:17:24 UTC DEBUG virtual-assistant Session attributes: ['_auto_result', '_bookmark_manager', '_bookmarks', '_check_state', '_closed', '_config', '_connect', '_connection',...
time2026-07-27 02:17:24 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/neo4j_client.py:850
clustermaster
versionunknown
trace1d4bc72280647cedd4b5e39e57d92618
span4b8f923a7f83aec4
podvirtual-assistant-65b975d66b-l8wpw
message
Session attributes: ['_auto_result', '_bookmark_manager', '_bookmarks', '_check_state', '_closed', '_config', '_connect', '_connection', '_connection_access_mode', '_disconnect', '_get_bookmarks', '_get_routing_target_database', '_get_server_info', '_handle_cancellation', '_initial_bookmarks', '_initialize_bookmarks', '_last_cache_key', '_last_from_bookmark_manager', '_make_db_resolution_callback', '_non_concurrent_iter', '_non_concurrent_method', '_open_transaction', '_pinned_database', '_pipelined_begin', '_pool', '_resolve_session_auth', '_result_closed', '_result_error', '_run_transaction', '_set_pinned_database', '_state_failed', '_transaction', '_transaction_cancel_handler', '_transaction_closed_handler', '_transaction_error_handler', '_update_bookmark', '_update_bookmarks', '_verify_authentication', 'begin_transaction', 'close', 'closed', 'execute_read', 'execute_write', 'last_bookmark', 'last_bookmarks', 'read_transaction', 'run', 'write_transaction']
raw payload (9 fields)
{
"caller": "src/neo4j_client.py:850",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Session attributes: [\u0027_auto_result\u0027, \u0027_bookmark_manager\u0027, \u0027_bookmarks\u0027, \u0027_check_state\u0027, \u0027_closed\u0027, \u0027_config\u0027, \u0027_connect\u0027, \u0027_connection\u0027, \u0027_connection_access_mode\u0027, \u0027_disconnect\u0027, \u0027_get_bookmarks\u0027, \u0027_get_routing_target_database\u0027, \u0027_get_server_info\u0027, \u0027_handle_cancellation\u0027, \u0027_initial_bookmarks\u0027, \u0027_initialize_bookmarks\u0027, \u0027_last_cache_key\u0027, \u0027_last_from_bookmark_manager\u0027, \u0027_make_db_resolution_callback\u0027, \u0027_non_concurrent_iter\u0027, \u0027_non_concurrent_method\u0027, \u0027_open_transaction\u0027, \u0027_pinned_database\u0027, \u0027_pipelined_begin\u0027, \u0027_pool\u0027, \u0027_resolve_session_auth\u0027, \u0027_result_closed\u0027, \u0027_result_error\u0027, \u0027_run_transaction\u0027, \u0027_set_pinned_database\u0027, \u0027_state_failed\u0027, \u0027_transaction\u0027, \u0027_transaction_cancel_handler\u0027, \u0027_transaction_closed_handler\u0027, \u0027_transaction_error_handler\u0027, \u0027_update_bookmark\u0027, \u0027_update_bookmarks\u0027, \u0027_verify_authentication\u0027, \u0027begin_transaction\u0027, \u0027close\u0027, \u0027closed\u0027, \u0027execute_read\u0027, \u0027execute_write\u0027, \u0027last_bookmark\u0027, \u0027last_bookmarks\u0027, \u0027read_transaction\u0027, \u0027run\u0027, \u0027write_transaction\u0027]",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:24.114Z",
"version": "unknown"
}25s ago2026-07-27 02:17:24 UTC DEBUG virtual-assistant Pool attributes: ['_abc_impl', '_acquire', '_acquire_from_pool', '_acquire_from_pool_checked', '_acquire_new_later', '_add_connections',...
time2026-07-27 02:17:24 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/neo4j_client.py:796
clustermaster
versionunknown
trace1d4bc72280647cedd4b5e39e57d92618
span4b8f923a7f83aec4
podvirtual-assistant-65b975d66b-l8wpw
message
Pool attributes: ['_abc_impl', '_acquire', '_acquire_from_pool', '_acquire_from_pool_checked', '_acquire_new_later', '_add_connections', '_close_connections', '_re_auth_connection', '_remove_connection', '_remove_connections', '_select_address', '_ssr_feature_tracker', '_update_routing_table_from', 'acquire', 'address', 'close', 'cond', 'connections', 'connections_reservations', 'deactivate', 'ensure_routing_table_is_fresh', 'fetch_routing_info', 'fetch_routing_table', 'get_auth', 'get_or_create_routing_table', 'get_routing_table', 'home_db_cache', 'in_use_connection_count', 'is_direct_pool', 'kill_and_release', 'lock', 'mark_all_stale', 'on_neo4j_error', 'on_write_failure', 'open', 'opener', 'pool_config', 'refresh_lock', 'release', 'routing_tables', 'ssr_enabled', 'update_connection_pool', 'update_routing_table', 'workspace_config']
raw payload (9 fields)
{
"caller": "src/neo4j_client.py:796",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Pool attributes: [\u0027_abc_impl\u0027, \u0027_acquire\u0027, \u0027_acquire_from_pool\u0027, \u0027_acquire_from_pool_checked\u0027, \u0027_acquire_new_later\u0027, \u0027_add_connections\u0027, \u0027_close_connections\u0027, \u0027_re_auth_connection\u0027, \u0027_remove_connection\u0027, \u0027_remove_connections\u0027, \u0027_select_address\u0027, \u0027_ssr_feature_tracker\u0027, \u0027_update_routing_table_from\u0027, \u0027acquire\u0027, \u0027address\u0027, \u0027close\u0027, \u0027cond\u0027, \u0027connections\u0027, \u0027connections_reservations\u0027, \u0027deactivate\u0027, \u0027ensure_routing_table_is_fresh\u0027, \u0027fetch_routing_info\u0027, \u0027fetch_routing_table\u0027, \u0027get_auth\u0027, \u0027get_or_create_routing_table\u0027, \u0027get_routing_table\u0027, \u0027home_db_cache\u0027, \u0027in_use_connection_count\u0027, \u0027is_direct_pool\u0027, \u0027kill_and_release\u0027, \u0027lock\u0027, \u0027mark_all_stale\u0027, \u0027on_neo4j_error\u0027, \u0027on_write_failure\u0027, \u0027open\u0027, \u0027opener\u0027, \u0027pool_config\u0027, \u0027refresh_lock\u0027, \u0027release\u0027, \u0027routing_tables\u0027, \u0027ssr_enabled\u0027, \u0027update_connection_pool\u0027, \u0027update_routing_table\u0027, \u0027workspace_config\u0027]",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:24.114Z",
"version": "unknown"
}25s ago2026-07-27 02:17:24 UTC DEBUG virtual-assistant Driver attributes: ['_check_state', '_closed', '_default_workspace_config', '_get_server_info', '_initial_addresses', '_pool',...
time2026-07-27 02:17:24 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/neo4j_client.py:787
clustermaster
versionunknown
trace1d4bc72280647cedd4b5e39e57d92618
span4b8f923a7f83aec4
podvirtual-assistant-65b975d66b-l8wpw
message
Driver attributes: ['_check_state', '_closed', '_default_workspace_config', '_get_server_info', '_initial_addresses', '_pool', '_prepare_session_config', '_query_bookmark_manager', '_read_session_config', '_session', 'close', 'default_host', 'default_port', 'default_targets', 'encrypted', 'execute_query', 'execute_query_bookmark_manager', 'get_server_info', 'initial_addresses', 'open', 'parse_targets', 'session', 'supports_multi_db', 'supports_session_auth', 'verify_authentication', 'verify_connectivity']
raw payload (9 fields)
{
"caller": "src/neo4j_client.py:787",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Driver attributes: [\u0027_check_state\u0027, \u0027_closed\u0027, \u0027_default_workspace_config\u0027, \u0027_get_server_info\u0027, \u0027_initial_addresses\u0027, \u0027_pool\u0027, \u0027_prepare_session_config\u0027, \u0027_query_bookmark_manager\u0027, \u0027_read_session_config\u0027, \u0027_session\u0027, \u0027close\u0027, \u0027default_host\u0027, \u0027default_port\u0027, \u0027default_targets\u0027, \u0027encrypted\u0027, \u0027execute_query\u0027, \u0027execute_query_bookmark_manager\u0027, \u0027get_server_info\u0027, \u0027initial_addresses\u0027, \u0027open\u0027, \u0027parse_targets\u0027, \u0027session\u0027, \u0027supports_multi_db\u0027, \u0027supports_session_auth\u0027, \u0027verify_authentication\u0027, \u0027verify_connectivity\u0027]",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:24.114Z",
"version": "unknown"
}25s ago2026-07-27 02:17:24 UTC DEBUG virtual-assistant 🔍 AUTH_DEBUG: Path in UNPROTECTED_ENDPOINTS: True
time2026-07-27 02:17:24 UTC
severityDEBUG
servicevirtual-assistant
sourceapi/api.py:491
clustermaster
versionunknown
trace1d4bc72280647cedd4b5e39e57d92618
span4b8f923a7f83aec4
podvirtual-assistant-65b975d66b-l8wpw
message
🔍 AUTH_DEBUG: Path in UNPROTECTED_ENDPOINTS: True
raw payload (9 fields)
{
"caller": "api/api.py:491",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\ud83d\udd0d AUTH_DEBUG: Path in UNPROTECTED_ENDPOINTS: True",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:24.110Z",
"version": "unknown"
}25s ago2026-07-27 02:17:24 UTC DEBUG virtual-assistant 🔍 AUTH_DEBUG: Method: GET
time2026-07-27 02:17:24 UTC
severityDEBUG
servicevirtual-assistant
sourceapi/api.py:489
clustermaster
versionunknown
trace1d4bc72280647cedd4b5e39e57d92618
span4b8f923a7f83aec4
podvirtual-assistant-65b975d66b-l8wpw
message
🔍 AUTH_DEBUG: Method: GET
raw payload (9 fields)
{
"caller": "api/api.py:489",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\ud83d\udd0d AUTH_DEBUG: Method: GET",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:24.110Z",
"version": "unknown"
}26s ago2026-07-27 02:17:23 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:23 UTC
severityERROR
clustermaster
podswaggersvc-86f5455f58-zqm46
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
27s ago2026-07-27 02:17:22 UTC neo4j advpsvc match(a:AdvRateRule{deleted:true})-[r]-(b) with distinct a return a.portalorgid, a.tildaid, a.ruletype limit 10
time2026-07-27 02:17:22 UTC
severityINFO
serviceadvpsvc
clustermaster
podserver-3-dev-0
query
match(a:AdvRateRule{deleted:true})-[r]-(b)
with distinct a
return a.portalorgid, a.tildaid, a.ruletype
limit 10
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 2.0,
"elapsedTimeMs": 2.0,
"executionPlanCacheKeyHash": "AFAFBFFB",
"id": "13641028",
"pageFaults": 0.0,
"pageHits": 1146.0,
"planning": 0.0,
"query": "match(a:AdvRateRule{deleted:true})-[r]-(b) with distinct a return a.portalorgid, a.tildaid, a.ruletype limit 10",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:22.158Z",
"transactionId": 1756245.0,
"waiting": 0.0
}28s ago2026-07-27 02:17:21 UTC DEBUG virtual-assistant [mem] background_reclaimer executed
time2026-07-27 02:17:21 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/main.py:540
clustermaster
versionunknown
podvirtual-assistant-65b975d66b-l8wpw
message
[mem] background_reclaimer executed
raw payload (7 fields)
{
"caller": "src/main.py:540",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[mem] background_reclaimer executed",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:21.794Z",
"version": "unknown"
}28s ago2026-07-27 02:17:21 UTC DEBUG virtual-assistant aggressive_memory_release: GC skipped based on should_run_gc() decision
time2026-07-27 02:17:21 UTC
severityDEBUG
servicevirtual-assistant
sourcecommon/mem_release.py:79
clustermaster
versionunknown
podvirtual-assistant-65b975d66b-l8wpw
message
aggressive_memory_release: GC skipped based on should_run_gc() decision
raw payload (7 fields)
{
"caller": "common/mem_release.py:79",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "aggressive_memory_release: GC skipped based on should_run_gc() decision",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:21.793Z",
"version": "unknown"
}28s ago2026-07-27 02:17:21 UTC DEBUG virtual-assistant should_run_gc: mem usage: 22.9% (457.8MB/2000.0MB), GC gen0 counts=2
time2026-07-27 02:17:21 UTC
severityDEBUG
servicevirtual-assistant
sourcereg/memory_monitor.py:464
clustermaster
versionunknown
podvirtual-assistant-65b975d66b-l8wpw
message
should_run_gc: mem usage: 22.9% (457.8MB/2000.0MB), GC gen0 counts=2
raw payload (7 fields)
{
"caller": "reg/memory_monitor.py:464",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "should_run_gc: mem usage: 22.9% (457.8MB/2000.0MB), GC gen0 counts=2",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:21.793Z",
"version": "unknown"
}29s ago2026-07-27 02:17:20 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:20 UTC
severityINFO
clustermaster
podlitellm-f54655c99-tt2pg
29s ago2026-07-27 02:17:20 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:20 UTC
severityINFO
clustermaster
podrag-agent-57879dd94f-l9nz7
29s ago2026-07-27 02:17:20 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:20 UTC
severityERROR
clustermaster
poddashql-77f7d55ffc-97fsq
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
29s ago2026-07-27 02:17:20 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:20 UTC
severityERROR
clustermaster
podsynthea-8b797c55c-79hm4
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
30s ago2026-07-27 02:17:19 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:19 UTC
severityINFO
clustermaster
podlitellm-f54655c99-tt2pg
30s ago2026-07-27 02:17:19 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:19 UTC
severityINFO
clustermaster
podrag-agent-57879dd94f-l9nz7
30s ago2026-07-27 02:17:19 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:19 UTC
severityERROR
clustermaster
poddocsvc-5698bb997f-pc9ql
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
31s ago2026-07-27 02:17:18 UTC DEBUG workplansvc TransactionID commit
time2026-07-27 02:17:18 UTC
severityDEBUG
serviceworkplansvc
sourcetildadb/api.go:2575
clustermaster
versionunknown
podworkplansvc-75f7d8dcb6-jxnsg
message
TransactionID commit
raw payload (8 fields)
{
"caller": "tildadb/api.go:2575",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "TransactionID commit",
"service": "workplansvc",
"timestamp": "2026-07-27T02:17:18.728Z",
"transactionID": "FB:kcwQc8qrjECqRtOxBB1HjVmAmsoAPplvkA==",
"version": "unknown"
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc CREATE (a:WorkplanInstanceEvent{deltimestamp:0}) SET a.createdat = timestamp(), a.updatedat = timestamp(), a.tildaid = randomUUID(),...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-2-dev-0
query
CREATE (a:WorkplanInstanceEvent{deltimestamp:0})
SET a.createdat = timestamp(), a.updatedat = timestamp(), a.tildaid = randomUUID(), a.holdbitmap=0,a.holdbitmap=0,a.delpending=false,a.instanceId="4f4a2dc3-117b-4b69-a1c1-8944eb009099",a.orgId="a5fb9821-522a-4061-823f-b0a66173a204",a.eventType="sweeper_send_blocked",a.requestId="",a.summary="Sweeper skipped send: 1 unlinked work order(s)",a.payloadJson='{"reason":"unlinked_work_orders","unlinkedWorkOrderCount":1}'
RETURN a.tildaid, a.createdat
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "C23BE7B4",
"id": "25356882",
"pageFaults": 0.0,
"pageHits": 0.0,
"planning": 0.0,
"query": "CREATE (a:WorkplanInstanceEvent{deltimestamp:0}) SET a.createdat = timestamp(), a.updatedat = timestamp(), a.tildaid = randomUUID(), a.holdbitmap=0,a.holdbitmap=0,a.delpending=false,a.instanceId=\"4f4a2dc3-117b-4b69-a1c1-8944eb009099\",a.orgId=\"a5fb9821-522a-4061-823f-b0a66173a204\",a.eventType=\"sweeper_send_blocked\",a.requestId=\"\",a.summary=\"Sweeper skipped send: 1 unlinked work order(s)\",a.payloadJson=\u0027{\"reason\":\"unlinked_work_orders\",\"unlinkedWorkOrderCount\":1}\u0027 RETURN a.tildaid, a.createdat",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.2.71:49876\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:18.714Z",
"transactionId": 12246579.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (org:Organization)-[:ORGANIZATION_TO_WORKPLAN_INSTANCE]->(wp:WorkPlanInstance{tildaid:"4f4a2dc3-117b-4b69-a1c1-8944eb009099"}) RETURN...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-2-dev-0
query
MATCH (org:Organization)-[:ORGANIZATION_TO_WORKPLAN_INSTANCE]->(wp:WorkPlanInstance{tildaid:"4f4a2dc3-117b-4b69-a1c1-8944eb009099"})
RETURN org.tildaid as oid
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "CB2C51F3",
"id": "25356879",
"pageFaults": 0.0,
"pageHits": 414.0,
"planning": 0.0,
"query": "\n\t\tMATCH (org:Organization)-[:ORGANIZATION_TO_WORKPLAN_INSTANCE]-\u003e(wp:WorkPlanInstance{tildaid:\"4f4a2dc3-117b-4b69-a1c1-8944eb009099\"})\n\t\tRETURN org.tildaid as oid\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.2.71:49876\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:18.710Z",
"transactionId": 12246579.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC DEBUG workplansvc TransactionID
time2026-07-27 02:17:18 UTC
severityDEBUG
serviceworkplansvc
sourcetildadb/api.go:2482
clustermaster
versionunknown
podworkplansvc-75f7d8dcb6-jxnsg
message
TransactionID
raw payload (8 fields)
{
"caller": "tildadb/api.go:2482",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "TransactionID",
"service": "workplansvc",
"timestamp": "2026-07-27T02:17:18.707Z",
"transactionID": "",
"version": "unknown"
}31s ago2026-07-27 02:17:18 UTC DEBUG workplansvc TransactionID commit
time2026-07-27 02:17:18 UTC
severityDEBUG
serviceworkplansvc
sourcetildadb/api.go:2575
clustermaster
versionunknown
podworkplansvc-75f7d8dcb6-jxnsg
message
TransactionID commit
raw payload (8 fields)
{
"caller": "tildadb/api.go:2575",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "TransactionID commit",
"service": "workplansvc",
"timestamp": "2026-07-27T02:17:18.685Z",
"transactionID": "FB:kcwQc8qrjECqRtOxBB1HjVmAmsoAPplukA==",
"version": "unknown"
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc CREATE (a:WorkplanInstanceEvent{deltimestamp:0}) SET a.createdat = timestamp(), a.updatedat = timestamp(), a.tildaid = randomUUID(),...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-2-dev-0
query
CREATE (a:WorkplanInstanceEvent{deltimestamp:0})
SET a.createdat = timestamp(), a.updatedat = timestamp(), a.tildaid = randomUUID(), a.holdbitmap=0,a.holdbitmap=0,a.delpending=false,a.instanceId="8cb2d38c-046c-4910-bb36-a02d9b856938",a.orgId="aa59151d-6c89-4c13-811b-0dffb1ed1693",a.eventType="sweeper_send_blocked",a.requestId="",a.summary="Sweeper skipped send: 1 unlinked work order(s)",a.payloadJson='{"reason":"unlinked_work_orders","unlinkedWorkOrderCount":1}'
RETURN a.tildaid, a.createdat
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "C23BE7B4",
"id": "25356871",
"pageFaults": 0.0,
"pageHits": 0.0,
"planning": 0.0,
"query": "CREATE (a:WorkplanInstanceEvent{deltimestamp:0}) SET a.createdat = timestamp(), a.updatedat = timestamp(), a.tildaid = randomUUID(), a.holdbitmap=0,a.holdbitmap=0,a.delpending=false,a.instanceId=\"8cb2d38c-046c-4910-bb36-a02d9b856938\",a.orgId=\"aa59151d-6c89-4c13-811b-0dffb1ed1693\",a.eventType=\"sweeper_send_blocked\",a.requestId=\"\",a.summary=\"Sweeper skipped send: 1 unlinked work order(s)\",a.payloadJson=\u0027{\"reason\":\"unlinked_work_orders\",\"unlinkedWorkOrderCount\":1}\u0027 RETURN a.tildaid, a.createdat",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tGo Driver/5.20.0\t\tclient/10.129.4.159:45492\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:18.675Z",
"transactionId": 12246578.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (org:Organization)-[:ORGANIZATION_TO_WORKPLAN_INSTANCE]->(wp:WorkPlanInstance{tildaid:"8cb2d38c-046c-4910-bb36-a02d9b856938"}) RETURN...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-2-dev-0
query
MATCH (org:Organization)-[:ORGANIZATION_TO_WORKPLAN_INSTANCE]->(wp:WorkPlanInstance{tildaid:"8cb2d38c-046c-4910-bb36-a02d9b856938"})
RETURN org.tildaid as oid
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "CB2C51F3",
"id": "25356870",
"pageFaults": 0.0,
"pageHits": 414.0,
"planning": 0.0,
"query": "\n\t\tMATCH (org:Organization)-[:ORGANIZATION_TO_WORKPLAN_INSTANCE]-\u003e(wp:WorkPlanInstance{tildaid:\"8cb2d38c-046c-4910-bb36-a02d9b856938\"})\n\t\tRETURN org.tildaid as oid\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tGo Driver/5.20.0\t\tclient/10.129.4.159:45492\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:18.672Z",
"transactionId": 12246578.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC DEBUG workplansvc TransactionID
time2026-07-27 02:17:18 UTC
severityDEBUG
serviceworkplansvc
sourcetildadb/api.go:2482
clustermaster
versionunknown
podworkplansvc-75f7d8dcb6-jxnsg
message
TransactionID
raw payload (8 fields)
{
"caller": "tildadb/api.go:2482",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "TransactionID",
"service": "workplansvc",
"timestamp": "2026-07-27T02:17:18.670Z",
"transactionID": "",
"version": "unknown"
}31s ago2026-07-27 02:17:18 UTC DEBUG workplansvc workplan periodic sweep
time2026-07-27 02:17:18 UTC
severityDEBUG
serviceworkplansvc
sourceworkplan/summarization_sweep_ticker.go:90
clustermaster
versionunknown
podworkplansvc-75f7d8dcb6-jxnsg
message
workplan periodic sweep
raw payload (15 fields)
{
"activates_published": 0.0,
"autosend_catchups": 0.0,
"caller": "workplan/summarization_sweep_ticker.go:90",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "workplan periodic sweep",
"progress_summarized": 0.0,
"ready_det_repaired_desync": 0.0,
"ready_det_send_published": 0.0,
"ready_det_skipped_blocked": 2.0,
"recipient_retries": 0.0,
"service": "workplansvc",
"timestamp": "2026-07-27T02:17:18.669Z",
"trigger": "tick",
"version": "unknown"
}31s ago2026-07-27 02:17:18 UTC DEBUG workplansvc ready determination sweep: skip pending (unlinked work orders)
time2026-07-27 02:17:18 UTC
severityDEBUG
serviceworkplansvc
sourcepubsub/instance_ready_determination.go:352
clustermaster
versionunknown
podworkplansvc-75f7d8dcb6-jxnsg
message
ready determination sweep: skip pending (unlinked work orders)
raw payload (9 fields)
{
"caller": "pubsub/instance_ready_determination.go:352",
"cluster": "master",
"environment": "DEVELOPMENT",
"instance_id": "8cb2d38c-046c-4910-bb36-a02d9b856938",
"message": "ready determination sweep: skip pending (unlinked work orders)",
"service": "workplansvc",
"timestamp": "2026-07-27T02:17:18.668Z",
"unlinked_work_order_count": 1.0,
"version": "unknown"
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
MATCH (wp:WorkPlanInstance{tildaid:"8cb2d38c-046c-4910-bb36-a02d9b856938"})-[:WORKPLAN_INSTANCE_TO_MILESTONE]->(:WorkPlanMilestone)-[:REL_WORKPLAN_INSTANCE_MILESTONE_TO_ITEM]->(item:WorkplanInstanceMilestoneItem)
WHERE item.itemType = "Workorder"
AND coalesce(item.skippedAt, 0) = 0
AND coalesce(item.notApplicableAt, 0) = 0
AND coalesce(item.workOrderCompletedAt, 0) = 0
AND coalesce(item.workOrderId, "") = ""
RETURN count(item) AS n
raw payload (15 fields)
{
"allocatedBytes": 488.0,
"cpu": 1.0,
"elapsedTimeMs": 2.0,
"executionPlanCacheKeyHash": "0CD31179",
"id": "17603124",
"pageFaults": 0.0,
"pageHits": 454.0,
"planning": 0.0,
"query": "\n\t\tMATCH (wp:WorkPlanInstance{tildaid:\"8cb2d38c-046c-4910-bb36-a02d9b856938\"})-[:WORKPLAN_INSTANCE_TO_MILESTONE]-\u003e(:WorkPlanMilestone)-[:REL_WORKPLAN_INSTANCE_MILESTONE_TO_ITEM]-\u003e(item:WorkplanInstanceMilestoneItem)\n\t\tWHERE item.itemType = \"Workorder\"\n\t\t AND coalesce(item.skippedAt, 0) = 0\n\t\t AND coalesce(item.notApplicableAt, 0) = 0\n\t\t AND coalesce(item.workOrderCompletedAt, 0) = 0\n\t\t AND coalesce(item.workOrderId, \"\") = \"\"\n\t\tRETURN count(item) AS n\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.664Z",
"transactionId": 1776281.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC DEBUG workplansvc ready determination sweep: skip pending (unlinked work orders)
time2026-07-27 02:17:18 UTC
severityDEBUG
serviceworkplansvc
sourcepubsub/instance_ready_determination.go:352
clustermaster
versionunknown
podworkplansvc-75f7d8dcb6-jxnsg
message
ready determination sweep: skip pending (unlinked work orders)
raw payload (9 fields)
{
"caller": "pubsub/instance_ready_determination.go:352",
"cluster": "master",
"environment": "DEVELOPMENT",
"instance_id": "4f4a2dc3-117b-4b69-a1c1-8944eb009099",
"message": "ready determination sweep: skip pending (unlinked work orders)",
"service": "workplansvc",
"timestamp": "2026-07-27T02:17:18.658Z",
"unlinked_work_order_count": 1.0,
"version": "unknown"
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
MATCH (wp:WorkPlanInstance{tildaid:"4f4a2dc3-117b-4b69-a1c1-8944eb009099"})-[:WORKPLAN_INSTANCE_TO_MILESTONE]->(:WorkPlanMilestone)-[:REL_WORKPLAN_INSTANCE_MILESTONE_TO_ITEM]->(item:WorkplanInstanceMilestoneItem)
WHERE item.itemType = "Workorder"
AND coalesce(item.skippedAt, 0) = 0
AND coalesce(item.notApplicableAt, 0) = 0
AND coalesce(item.workOrderCompletedAt, 0) = 0
AND coalesce(item.workOrderId, "") = ""
RETURN count(item) AS n
raw payload (15 fields)
{
"allocatedBytes": 488.0,
"cpu": 1.0,
"elapsedTimeMs": 2.0,
"executionPlanCacheKeyHash": "0CD31179",
"id": "13640980",
"pageFaults": 0.0,
"pageHits": 452.0,
"planning": 0.0,
"query": "\n\t\tMATCH (wp:WorkPlanInstance{tildaid:\"4f4a2dc3-117b-4b69-a1c1-8944eb009099\"})-[:WORKPLAN_INSTANCE_TO_MILESTONE]-\u003e(:WorkPlanMilestone)-[:REL_WORKPLAN_INSTANCE_MILESTONE_TO_ITEM]-\u003e(item:WorkplanInstanceMilestoneItem)\n\t\tWHERE item.itemType = \"Workorder\"\n\t\t AND coalesce(item.skippedAt, 0) = 0\n\t\t AND coalesce(item.notApplicableAt, 0) = 0\n\t\t AND coalesce(item.workOrderCompletedAt, 0) = 0\n\t\t AND coalesce(item.workOrderId, \"\") = \"\"\n\t\tRETURN count(item) AS n\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.654Z",
"transactionId": 1756244.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC DEBUG workplansvc TransactionID commit
time2026-07-27 02:17:18 UTC
severityDEBUG
serviceworkplansvc
sourcetildadb/api.go:2575
clustermaster
versionunknown
podworkplansvc-75f7d8dcb6-jxnsg
message
TransactionID commit
raw payload (8 fields)
{
"caller": "tildadb/api.go:2575",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "TransactionID commit",
"service": "workplansvc",
"timestamp": "2026-07-27T02:17:18.647Z",
"transactionID": "FB:kcwQc8qrjECqRtOxBB1HjVmAmsoAPpltkA==",
"version": "unknown"
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (wp:WorkPlanInstance) WHERE wp.instanceReadyDeterminationState = "pending" AND wp.state <> "archived" RETURN wp.tildaid AS...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-2-dev-0
query
MATCH (wp:WorkPlanInstance) WHERE wp.instanceReadyDeterminationState = "pending" AND wp.state <> "archived" RETURN wp.tildaid AS id ORDER BY coalesce(wp.instanceReadyDeterminationUpdatedAt, 0) ASC LIMIT 50
raw payload (15 fields)
{
"allocatedBytes": 832.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "81C085B2",
"id": "25356859",
"pageFaults": 0.0,
"pageHits": 415.0,
"planning": 0.0,
"query": "\n\t\tMATCH (wp:WorkPlanInstance)\n\t\tWHERE wp.instanceReadyDeterminationState = \"pending\"\n\t\t AND wp.state \u003c\u003e \"archived\"\n\t\tRETURN wp.tildaid AS id\n\t\tORDER BY coalesce(wp.instanceReadyDeterminationUpdatedAt, 0) ASC\n\t\tLIMIT 50\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tGo Driver/5.20.0\t\tclient/10.129.4.159:45492\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:18.645Z",
"transactionId": 12246577.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (wp:WorkPlanInstance) WHERE wp.instanceReadyDeterminationState IN ["in_progress", "in_progress_and_pending"] AND wp.state <>...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-2-dev-0
query
MATCH (wp:WorkPlanInstance) WHERE wp.instanceReadyDeterminationState IN ["in_progress", "in_progress_and_pending"] AND wp.state <> "archived" OPTIONAL MATCH (wp)<-[:WORKPLAN_JOB_TO_OBJ]-(job:WorkplanJob) WITH wp, count(job) AS jobN WHERE jobN = 0 RETURN wp.tildaid AS id LIMIT 50
raw payload (15 fields)
{
"allocatedBytes": 1888.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "9B9F9D65",
"id": "25356857",
"pageFaults": 0.0,
"pageHits": 417.0,
"planning": 0.0,
"query": "\n\t\tMATCH (wp:WorkPlanInstance)\n\t\tWHERE wp.instanceReadyDeterminationState IN [\"in_progress\", \"in_progress_and_pending\"]\n\t\t AND wp.state \u003c\u003e \"archived\"\n\t\tOPTIONAL MATCH (wp)\u003c-[:WORKPLAN_JOB_TO_OBJ]-(job:WorkplanJob)\n\t\tWITH wp, count(job) AS jobN\n\t\tWHERE jobN = 0\n\t\tRETURN wp.tildaid AS id\n\t\tLIMIT 50\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tGo Driver/5.20.0\t\tclient/10.129.4.159:45492\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:18.642Z",
"transactionId": 12246577.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC DEBUG workplansvc TransactionID
time2026-07-27 02:17:18 UTC
severityDEBUG
serviceworkplansvc
sourcetildadb/api.go:2482
clustermaster
versionunknown
podworkplansvc-75f7d8dcb6-jxnsg
message
TransactionID
raw payload (8 fields)
{
"caller": "tildadb/api.go:2482",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "TransactionID",
"service": "workplansvc",
"timestamp": "2026-07-27T02:17:18.640Z",
"transactionID": "",
"version": "unknown"
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc UNWIND $site_ids AS sid OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false}) OPTIONAL MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
UNWIND $site_ids AS sid
OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})
OPTIONAL MATCH (s)<-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]->(st:Study {tildaid: $study_id, delpending: false})
OPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]->(actor:Actor {delpending: false})-[:FOR_USER]->(u:User)
OPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]->(co:ClinOp {deltimestamp: 0})-[:FOR_USER]->(cou:User)
WITH sid, s,
collect(DISTINCT CASE
WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status <> $deleted_status) THEN {
t: pdc.type,
p: coalesce(pdc.isPrimary, false),
e: coalesce(u.email, "")
} END) AS actorContactRows,
collect(DISTINCT CASE
WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status <> $deleted_status) THEN {
t: copdc.type,
p: coalesce(copdc.isPrimary, false),
e: coalesce(cou.email, "")
} END) AS clinopContactRows
WITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw
WITH sid, s,
[row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e <> ""] AS pd_rows
RETURN sid AS site_id, coalesce(s.name, "") AS site_name, pd_rows
raw payload (15 fields)
{
"allocatedBytes": 19512.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "97FB2855",
"id": "17603121",
"pageFaults": 0.0,
"pageHits": 17.0,
"planning": 0.0,
"query": "\nUNWIND $site_ids AS sid\nOPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})\nOPTIONAL MATCH (s)\u003c-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]-\u003e(st:Study {tildaid: $study_id, delpending: false})\nOPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]-\u003e(actor:Actor {delpending: false})-[:FOR_USER]-\u003e(u:User)\nOPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]-\u003e(co:ClinOp {deltimestamp: 0})-[:FOR_USER]-\u003e(cou:User)\nWITH sid, s,\n collect(DISTINCT CASE\n WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status \u003c\u003e $deleted_status) THEN {\n t: pdc.type,\n p: coalesce(pdc.isPrimary, false),\n e: coalesce(u.email, \"\")\n } END) AS actorContactRows,\n collect(DISTINCT CASE\n WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status \u003c\u003e $deleted_status) THEN {\n t: copdc.type,\n p: coalesce(copdc.isPrimary, false),\n e: coalesce(cou.email, \"\")\n } END) AS clinopContactRows\nWITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw\nWITH sid, s,\n [row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e \u003c\u003e \"\"] AS pd_rows\nRETURN sid AS site_id, coalesce(s.name, \"\") AS site_name, pd_rows\n",
"queryParameters": "{deleted_status: \u0027Deleted\u0027, site_ids: [\u00276ef91479-dbf6-4a3b-82b9-4c07b66b8eb4\u0027], study_id: \u002716ffa942-94ca-4e1c-88f7-e0d87180dfe8\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.634Z",
"transactionId": 1776280.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (instance:WorkPlanInstance{tildaid:"a1492aa6-ba07-49a9-aa99-0758bbdd18d3"})-[:WORKPLAN_TO_SITE]->(site:Site) RETURN site.tildaid as siteId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
MATCH (instance:WorkPlanInstance{tildaid:"a1492aa6-ba07-49a9-aa99-0758bbdd18d3"})-[:WORKPLAN_TO_SITE]->(site:Site)
RETURN site.tildaid as siteId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "9B774BFC",
"id": "13640977",
"pageFaults": 0.0,
"pageHits": 414.0,
"planning": 0.0,
"query": "\n\t\tMATCH (instance:WorkPlanInstance{tildaid:\"a1492aa6-ba07-49a9-aa99-0758bbdd18d3\"})-[:WORKPLAN_TO_SITE]-\u003e(site:Site)\n\t\tRETURN site.tildaid as siteId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.624Z",
"transactionId": 1756243.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (cfg:WorkplanCfg{tildaid:"92f49070-1232-4531-bb13-73157a75b154"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study) RETURN study.tildaid as studyId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
MATCH (cfg:WorkplanCfg{tildaid:"92f49070-1232-4531-bb13-73157a75b154"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study)
RETURN study.tildaid as studyId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "682A7B96",
"id": "17603120",
"pageFaults": 0.0,
"pageHits": 329.0,
"planning": 0.0,
"query": "\n\t\tMATCH (cfg:WorkplanCfg{tildaid:\"92f49070-1232-4531-bb13-73157a75b154\"})-[:WORKPLAN_CFG_TO_STUDY]-\u003e(study:Study)\n\t\tRETURN study.tildaid as studyId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.614Z",
"transactionId": 1776279.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:18 UTC
severityERROR
clustermaster
podenrollsvc-5fc97ccf8b-sc8q5
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
31s ago2026-07-27 02:17:18 UTC neo4j workplansvc UNWIND $site_ids AS sid OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false}) OPTIONAL MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
UNWIND $site_ids AS sid
OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})
OPTIONAL MATCH (s)<-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]->(st:Study {tildaid: $study_id, delpending: false})
OPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]->(actor:Actor {delpending: false})-[:FOR_USER]->(u:User)
OPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]->(co:ClinOp {deltimestamp: 0})-[:FOR_USER]->(cou:User)
WITH sid, s,
collect(DISTINCT CASE
WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status <> $deleted_status) THEN {
t: pdc.type,
p: coalesce(pdc.isPrimary, false),
e: coalesce(u.email, "")
} END) AS actorContactRows,
collect(DISTINCT CASE
WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status <> $deleted_status) THEN {
t: copdc.type,
p: coalesce(copdc.isPrimary, false),
e: coalesce(cou.email, "")
} END) AS clinopContactRows
WITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw
WITH sid, s,
[row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e <> ""] AS pd_rows
RETURN sid AS site_id, coalesce(s.name, "") AS site_name, pd_rows
raw payload (15 fields)
{
"allocatedBytes": 19512.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "3832EC22",
"id": "13640976",
"pageFaults": 0.0,
"pageHits": 46.0,
"planning": 0.0,
"query": "\nUNWIND $site_ids AS sid\nOPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})\nOPTIONAL MATCH (s)\u003c-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]-\u003e(st:Study {tildaid: $study_id, delpending: false})\nOPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]-\u003e(actor:Actor {delpending: false})-[:FOR_USER]-\u003e(u:User)\nOPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]-\u003e(co:ClinOp {deltimestamp: 0})-[:FOR_USER]-\u003e(cou:User)\nWITH sid, s,\n collect(DISTINCT CASE\n WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status \u003c\u003e $deleted_status) THEN {\n t: pdc.type,\n p: coalesce(pdc.isPrimary, false),\n e: coalesce(u.email, \"\")\n } END) AS actorContactRows,\n collect(DISTINCT CASE\n WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status \u003c\u003e $deleted_status) THEN {\n t: copdc.type,\n p: coalesce(copdc.isPrimary, false),\n e: coalesce(cou.email, \"\")\n } END) AS clinopContactRows\nWITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw\nWITH sid, s,\n [row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e \u003c\u003e \"\"] AS pd_rows\nRETURN sid AS site_id, coalesce(s.name, \"\") AS site_name, pd_rows\n",
"queryParameters": "{deleted_status: \u0027Deleted\u0027, site_ids: [\u0027f17cfa1f-97b5-4f9f-9b7b-a7d3cb0420a4\u0027], study_id: \u0027e47593bd-8d16-45f9-bda7-6875606eecc7\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.604Z",
"transactionId": 1756242.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (instance:WorkPlanInstance{tildaid:"a947c13c-168f-4975-a246-376dd9402562"})-[:WORKPLAN_TO_SITE]->(site:Site) RETURN site.tildaid as siteId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
MATCH (instance:WorkPlanInstance{tildaid:"a947c13c-168f-4975-a246-376dd9402562"})-[:WORKPLAN_TO_SITE]->(site:Site)
RETURN site.tildaid as siteId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "9B774BFC",
"id": "17603117",
"pageFaults": 0.0,
"pageHits": 414.0,
"planning": 0.0,
"query": "\n\t\tMATCH (instance:WorkPlanInstance{tildaid:\"a947c13c-168f-4975-a246-376dd9402562\"})-[:WORKPLAN_TO_SITE]-\u003e(site:Site)\n\t\tRETURN site.tildaid as siteId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.593Z",
"transactionId": 1776278.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (cfg:WorkplanCfg{tildaid:"b63053ca-d6b2-47b2-9dbb-effaf732dd75"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study) RETURN study.tildaid as studyId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
MATCH (cfg:WorkplanCfg{tildaid:"b63053ca-d6b2-47b2-9dbb-effaf732dd75"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study)
RETURN study.tildaid as studyId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "682A7B96",
"id": "13640975",
"pageFaults": 0.0,
"pageHits": 329.0,
"planning": 0.0,
"query": "\n\t\tMATCH (cfg:WorkplanCfg{tildaid:\"b63053ca-d6b2-47b2-9dbb-effaf732dd75\"})-[:WORKPLAN_CFG_TO_STUDY]-\u003e(study:Study)\n\t\tRETURN study.tildaid as studyId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.583Z",
"transactionId": 1756241.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc UNWIND $site_ids AS sid OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false}) OPTIONAL MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
UNWIND $site_ids AS sid
OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})
OPTIONAL MATCH (s)<-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]->(st:Study {tildaid: $study_id, delpending: false})
OPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]->(actor:Actor {delpending: false})-[:FOR_USER]->(u:User)
OPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]->(co:ClinOp {deltimestamp: 0})-[:FOR_USER]->(cou:User)
WITH sid, s,
collect(DISTINCT CASE
WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status <> $deleted_status) THEN {
t: pdc.type,
p: coalesce(pdc.isPrimary, false),
e: coalesce(u.email, "")
} END) AS actorContactRows,
collect(DISTINCT CASE
WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status <> $deleted_status) THEN {
t: copdc.type,
p: coalesce(copdc.isPrimary, false),
e: coalesce(cou.email, "")
} END) AS clinopContactRows
WITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw
WITH sid, s,
[row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e <> ""] AS pd_rows
RETURN sid AS site_id, coalesce(s.name, "") AS site_name, pd_rows
raw payload (15 fields)
{
"allocatedBytes": 19512.0,
"cpu": 0.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "97FB2855",
"id": "17603115",
"pageFaults": 0.0,
"pageHits": 29.0,
"planning": 0.0,
"query": "\nUNWIND $site_ids AS sid\nOPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})\nOPTIONAL MATCH (s)\u003c-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]-\u003e(st:Study {tildaid: $study_id, delpending: false})\nOPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]-\u003e(actor:Actor {delpending: false})-[:FOR_USER]-\u003e(u:User)\nOPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]-\u003e(co:ClinOp {deltimestamp: 0})-[:FOR_USER]-\u003e(cou:User)\nWITH sid, s,\n collect(DISTINCT CASE\n WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status \u003c\u003e $deleted_status) THEN {\n t: pdc.type,\n p: coalesce(pdc.isPrimary, false),\n e: coalesce(u.email, \"\")\n } END) AS actorContactRows,\n collect(DISTINCT CASE\n WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status \u003c\u003e $deleted_status) THEN {\n t: copdc.type,\n p: coalesce(copdc.isPrimary, false),\n e: coalesce(cou.email, \"\")\n } END) AS clinopContactRows\nWITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw\nWITH sid, s,\n [row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e \u003c\u003e \"\"] AS pd_rows\nRETURN sid AS site_id, coalesce(s.name, \"\") AS site_name, pd_rows\n",
"queryParameters": "{deleted_status: \u0027Deleted\u0027, site_ids: [\u0027a6259678-9d0f-4311-8051-d1dca2333297\u0027], study_id: \u002716ffa942-94ca-4e1c-88f7-e0d87180dfe8\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.573Z",
"transactionId": 1776277.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (instance:WorkPlanInstance{tildaid:"344bb43b-c114-414a-9ede-3024085e25ec"})-[:WORKPLAN_TO_SITE]->(site:Site) RETURN site.tildaid as siteId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
MATCH (instance:WorkPlanInstance{tildaid:"344bb43b-c114-414a-9ede-3024085e25ec"})-[:WORKPLAN_TO_SITE]->(site:Site)
RETURN site.tildaid as siteId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "9B774BFC",
"id": "13640974",
"pageFaults": 0.0,
"pageHits": 414.0,
"planning": 0.0,
"query": "\n\t\tMATCH (instance:WorkPlanInstance{tildaid:\"344bb43b-c114-414a-9ede-3024085e25ec\"})-[:WORKPLAN_TO_SITE]-\u003e(site:Site)\n\t\tRETURN site.tildaid as siteId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.563Z",
"transactionId": 1756240.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (cfg:WorkplanCfg{tildaid:"aa651aca-e3b1-437b-91c0-1a782428010b"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study) RETURN study.tildaid as studyId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
MATCH (cfg:WorkplanCfg{tildaid:"aa651aca-e3b1-437b-91c0-1a782428010b"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study)
RETURN study.tildaid as studyId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "682A7B96",
"id": "17603114",
"pageFaults": 0.0,
"pageHits": 329.0,
"planning": 0.0,
"query": "\n\t\tMATCH (cfg:WorkplanCfg{tildaid:\"aa651aca-e3b1-437b-91c0-1a782428010b\"})-[:WORKPLAN_CFG_TO_STUDY]-\u003e(study:Study)\n\t\tRETURN study.tildaid as studyId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.553Z",
"transactionId": 1776276.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc UNWIND $site_ids AS sid OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false}) OPTIONAL MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
UNWIND $site_ids AS sid
OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})
OPTIONAL MATCH (s)<-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]->(st:Study {tildaid: $study_id, delpending: false})
OPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]->(actor:Actor {delpending: false})-[:FOR_USER]->(u:User)
OPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]->(co:ClinOp {deltimestamp: 0})-[:FOR_USER]->(cou:User)
WITH sid, s,
collect(DISTINCT CASE
WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status <> $deleted_status) THEN {
t: pdc.type,
p: coalesce(pdc.isPrimary, false),
e: coalesce(u.email, "")
} END) AS actorContactRows,
collect(DISTINCT CASE
WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status <> $deleted_status) THEN {
t: copdc.type,
p: coalesce(copdc.isPrimary, false),
e: coalesce(cou.email, "")
} END) AS clinopContactRows
WITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw
WITH sid, s,
[row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e <> ""] AS pd_rows
RETURN sid AS site_id, coalesce(s.name, "") AS site_name, pd_rows
raw payload (15 fields)
{
"allocatedBytes": 19512.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "3832EC22",
"id": "13640973",
"pageFaults": 0.0,
"pageHits": 28.0,
"planning": 0.0,
"query": "\nUNWIND $site_ids AS sid\nOPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})\nOPTIONAL MATCH (s)\u003c-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]-\u003e(st:Study {tildaid: $study_id, delpending: false})\nOPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]-\u003e(actor:Actor {delpending: false})-[:FOR_USER]-\u003e(u:User)\nOPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]-\u003e(co:ClinOp {deltimestamp: 0})-[:FOR_USER]-\u003e(cou:User)\nWITH sid, s,\n collect(DISTINCT CASE\n WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status \u003c\u003e $deleted_status) THEN {\n t: pdc.type,\n p: coalesce(pdc.isPrimary, false),\n e: coalesce(u.email, \"\")\n } END) AS actorContactRows,\n collect(DISTINCT CASE\n WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status \u003c\u003e $deleted_status) THEN {\n t: copdc.type,\n p: coalesce(copdc.isPrimary, false),\n e: coalesce(cou.email, \"\")\n } END) AS clinopContactRows\nWITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw\nWITH sid, s,\n [row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e \u003c\u003e \"\"] AS pd_rows\nRETURN sid AS site_id, coalesce(s.name, \"\") AS site_name, pd_rows\n",
"queryParameters": "{deleted_status: \u0027Deleted\u0027, site_ids: [\u0027a6259678-9d0f-4311-8051-d1dca2333297\u0027], study_id: \u00270a62f219-a803-482f-8973-ab67b1a3baf7\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.543Z",
"transactionId": 1756239.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (instance:WorkPlanInstance{tildaid:"272b7c49-648b-454b-b9e4-34bbc9c082cc"})-[:WORKPLAN_TO_SITE]->(site:Site) RETURN site.tildaid as siteId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
MATCH (instance:WorkPlanInstance{tildaid:"272b7c49-648b-454b-b9e4-34bbc9c082cc"})-[:WORKPLAN_TO_SITE]->(site:Site)
RETURN site.tildaid as siteId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "9B774BFC",
"id": "17603112",
"pageFaults": 0.0,
"pageHits": 416.0,
"planning": 0.0,
"query": "\n\t\tMATCH (instance:WorkPlanInstance{tildaid:\"272b7c49-648b-454b-b9e4-34bbc9c082cc\"})-[:WORKPLAN_TO_SITE]-\u003e(site:Site)\n\t\tRETURN site.tildaid as siteId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.533Z",
"transactionId": 1776275.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (cfg:WorkplanCfg{tildaid:"a546762b-b73b-495c-b06f-543822164be1"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study) RETURN study.tildaid as studyId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
MATCH (cfg:WorkplanCfg{tildaid:"a546762b-b73b-495c-b06f-543822164be1"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study)
RETURN study.tildaid as studyId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "682A7B96",
"id": "13640972",
"pageFaults": 0.0,
"pageHits": 329.0,
"planning": 0.0,
"query": "\n\t\tMATCH (cfg:WorkplanCfg{tildaid:\"a546762b-b73b-495c-b06f-543822164be1\"})-[:WORKPLAN_CFG_TO_STUDY]-\u003e(study:Study)\n\t\tRETURN study.tildaid as studyId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.523Z",
"transactionId": 1756238.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc UNWIND $site_ids AS sid OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false}) OPTIONAL MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
UNWIND $site_ids AS sid
OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})
OPTIONAL MATCH (s)<-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]->(st:Study {tildaid: $study_id, delpending: false})
OPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]->(actor:Actor {delpending: false})-[:FOR_USER]->(u:User)
OPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]->(co:ClinOp {deltimestamp: 0})-[:FOR_USER]->(cou:User)
WITH sid, s,
collect(DISTINCT CASE
WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status <> $deleted_status) THEN {
t: pdc.type,
p: coalesce(pdc.isPrimary, false),
e: coalesce(u.email, "")
} END) AS actorContactRows,
collect(DISTINCT CASE
WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status <> $deleted_status) THEN {
t: copdc.type,
p: coalesce(copdc.isPrimary, false),
e: coalesce(cou.email, "")
} END) AS clinopContactRows
WITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw
WITH sid, s,
[row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e <> ""] AS pd_rows
RETURN sid AS site_id, coalesce(s.name, "") AS site_name, pd_rows
raw payload (15 fields)
{
"allocatedBytes": 19512.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "97FB2855",
"id": "17603111",
"pageFaults": 0.0,
"pageHits": 22.0,
"planning": 0.0,
"query": "\nUNWIND $site_ids AS sid\nOPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})\nOPTIONAL MATCH (s)\u003c-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]-\u003e(st:Study {tildaid: $study_id, delpending: false})\nOPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]-\u003e(actor:Actor {delpending: false})-[:FOR_USER]-\u003e(u:User)\nOPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]-\u003e(co:ClinOp {deltimestamp: 0})-[:FOR_USER]-\u003e(cou:User)\nWITH sid, s,\n collect(DISTINCT CASE\n WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status \u003c\u003e $deleted_status) THEN {\n t: pdc.type,\n p: coalesce(pdc.isPrimary, false),\n e: coalesce(u.email, \"\")\n } END) AS actorContactRows,\n collect(DISTINCT CASE\n WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status \u003c\u003e $deleted_status) THEN {\n t: copdc.type,\n p: coalesce(copdc.isPrimary, false),\n e: coalesce(cou.email, \"\")\n } END) AS clinopContactRows\nWITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw\nWITH sid, s,\n [row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e \u003c\u003e \"\"] AS pd_rows\nRETURN sid AS site_id, coalesce(s.name, \"\") AS site_name, pd_rows\n",
"queryParameters": "{deleted_status: \u0027Deleted\u0027, site_ids: [\u0027cec6713e-0087-4942-91db-316352bbca2c\u0027], study_id: \u00275b971f19-ded8-4c5d-8649-5b2a96841d67\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.513Z",
"transactionId": 1776274.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (instance:WorkPlanInstance{tildaid:"bad745ed-c7c6-496e-bd2b-1cbc61040198"})-[:WORKPLAN_TO_SITE]->(site:Site) RETURN site.tildaid as siteId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
MATCH (instance:WorkPlanInstance{tildaid:"bad745ed-c7c6-496e-bd2b-1cbc61040198"})-[:WORKPLAN_TO_SITE]->(site:Site)
RETURN site.tildaid as siteId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "9B774BFC",
"id": "13640971",
"pageFaults": 0.0,
"pageHits": 415.0,
"planning": 0.0,
"query": "\n\t\tMATCH (instance:WorkPlanInstance{tildaid:\"bad745ed-c7c6-496e-bd2b-1cbc61040198\"})-[:WORKPLAN_TO_SITE]-\u003e(site:Site)\n\t\tRETURN site.tildaid as siteId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.503Z",
"transactionId": 1756237.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (cfg:WorkplanCfg{tildaid:"cb82212d-9ee3-4739-9c4f-bec323411efb"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study) RETURN study.tildaid as studyId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
MATCH (cfg:WorkplanCfg{tildaid:"cb82212d-9ee3-4739-9c4f-bec323411efb"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study)
RETURN study.tildaid as studyId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "682A7B96",
"id": "17603109",
"pageFaults": 0.0,
"pageHits": 329.0,
"planning": 0.0,
"query": "\n\t\tMATCH (cfg:WorkplanCfg{tildaid:\"cb82212d-9ee3-4739-9c4f-bec323411efb\"})-[:WORKPLAN_CFG_TO_STUDY]-\u003e(study:Study)\n\t\tRETURN study.tildaid as studyId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.493Z",
"transactionId": 1776273.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc UNWIND $site_ids AS sid OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false}) OPTIONAL MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
UNWIND $site_ids AS sid
OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})
OPTIONAL MATCH (s)<-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]->(st:Study {tildaid: $study_id, delpending: false})
OPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]->(actor:Actor {delpending: false})-[:FOR_USER]->(u:User)
OPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]->(co:ClinOp {deltimestamp: 0})-[:FOR_USER]->(cou:User)
WITH sid, s,
collect(DISTINCT CASE
WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status <> $deleted_status) THEN {
t: pdc.type,
p: coalesce(pdc.isPrimary, false),
e: coalesce(u.email, "")
} END) AS actorContactRows,
collect(DISTINCT CASE
WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status <> $deleted_status) THEN {
t: copdc.type,
p: coalesce(copdc.isPrimary, false),
e: coalesce(cou.email, "")
} END) AS clinopContactRows
WITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw
WITH sid, s,
[row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e <> ""] AS pd_rows
RETURN sid AS site_id, coalesce(s.name, "") AS site_name, pd_rows
raw payload (15 fields)
{
"allocatedBytes": 19512.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "3832EC22",
"id": "13640970",
"pageFaults": 0.0,
"pageHits": 28.0,
"planning": 0.0,
"query": "\nUNWIND $site_ids AS sid\nOPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})\nOPTIONAL MATCH (s)\u003c-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]-\u003e(st:Study {tildaid: $study_id, delpending: false})\nOPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]-\u003e(actor:Actor {delpending: false})-[:FOR_USER]-\u003e(u:User)\nOPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]-\u003e(co:ClinOp {deltimestamp: 0})-[:FOR_USER]-\u003e(cou:User)\nWITH sid, s,\n collect(DISTINCT CASE\n WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status \u003c\u003e $deleted_status) THEN {\n t: pdc.type,\n p: coalesce(pdc.isPrimary, false),\n e: coalesce(u.email, \"\")\n } END) AS actorContactRows,\n collect(DISTINCT CASE\n WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status \u003c\u003e $deleted_status) THEN {\n t: copdc.type,\n p: coalesce(copdc.isPrimary, false),\n e: coalesce(cou.email, \"\")\n } END) AS clinopContactRows\nWITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw\nWITH sid, s,\n [row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e \u003c\u003e \"\"] AS pd_rows\nRETURN sid AS site_id, coalesce(s.name, \"\") AS site_name, pd_rows\n",
"queryParameters": "{deleted_status: \u0027Deleted\u0027, site_ids: [\u0027a6259678-9d0f-4311-8051-d1dca2333297\u0027], study_id: \u00270a62f219-a803-482f-8973-ab67b1a3baf7\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.484Z",
"transactionId": 1756236.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (instance:WorkPlanInstance{tildaid:"5ca8bb00-38a6-4d01-b31b-20cbe6b1a878"})-[:WORKPLAN_TO_SITE]->(site:Site) RETURN site.tildaid as siteId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
MATCH (instance:WorkPlanInstance{tildaid:"5ca8bb00-38a6-4d01-b31b-20cbe6b1a878"})-[:WORKPLAN_TO_SITE]->(site:Site)
RETURN site.tildaid as siteId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "9B774BFC",
"id": "17603107",
"pageFaults": 0.0,
"pageHits": 414.0,
"planning": 0.0,
"query": "\n\t\tMATCH (instance:WorkPlanInstance{tildaid:\"5ca8bb00-38a6-4d01-b31b-20cbe6b1a878\"})-[:WORKPLAN_TO_SITE]-\u003e(site:Site)\n\t\tRETURN site.tildaid as siteId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.474Z",
"transactionId": 1776272.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (cfg:WorkplanCfg{tildaid:"37e5546c-d37f-4d97-a4ac-f5ebcc616248"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study) RETURN study.tildaid as studyId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
MATCH (cfg:WorkplanCfg{tildaid:"37e5546c-d37f-4d97-a4ac-f5ebcc616248"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study)
RETURN study.tildaid as studyId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "682A7B96",
"id": "13640968",
"pageFaults": 0.0,
"pageHits": 329.0,
"planning": 0.0,
"query": "\n\t\tMATCH (cfg:WorkplanCfg{tildaid:\"37e5546c-d37f-4d97-a4ac-f5ebcc616248\"})-[:WORKPLAN_CFG_TO_STUDY]-\u003e(study:Study)\n\t\tRETURN study.tildaid as studyId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.465Z",
"transactionId": 1756235.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc UNWIND $site_ids AS sid OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false}) OPTIONAL MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
UNWIND $site_ids AS sid
OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})
OPTIONAL MATCH (s)<-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]->(st:Study {tildaid: $study_id, delpending: false})
OPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]->(actor:Actor {delpending: false})-[:FOR_USER]->(u:User)
OPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]->(co:ClinOp {deltimestamp: 0})-[:FOR_USER]->(cou:User)
WITH sid, s,
collect(DISTINCT CASE
WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status <> $deleted_status) THEN {
t: pdc.type,
p: coalesce(pdc.isPrimary, false),
e: coalesce(u.email, "")
} END) AS actorContactRows,
collect(DISTINCT CASE
WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status <> $deleted_status) THEN {
t: copdc.type,
p: coalesce(copdc.isPrimary, false),
e: coalesce(cou.email, "")
} END) AS clinopContactRows
WITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw
WITH sid, s,
[row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e <> ""] AS pd_rows
RETURN sid AS site_id, coalesce(s.name, "") AS site_name, pd_rows
raw payload (15 fields)
{
"allocatedBytes": 19512.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "97FB2855",
"id": "17603105",
"pageFaults": 0.0,
"pageHits": 38.0,
"planning": 0.0,
"query": "\nUNWIND $site_ids AS sid\nOPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})\nOPTIONAL MATCH (s)\u003c-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]-\u003e(st:Study {tildaid: $study_id, delpending: false})\nOPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]-\u003e(actor:Actor {delpending: false})-[:FOR_USER]-\u003e(u:User)\nOPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]-\u003e(co:ClinOp {deltimestamp: 0})-[:FOR_USER]-\u003e(cou:User)\nWITH sid, s,\n collect(DISTINCT CASE\n WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status \u003c\u003e $deleted_status) THEN {\n t: pdc.type,\n p: coalesce(pdc.isPrimary, false),\n e: coalesce(u.email, \"\")\n } END) AS actorContactRows,\n collect(DISTINCT CASE\n WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status \u003c\u003e $deleted_status) THEN {\n t: copdc.type,\n p: coalesce(copdc.isPrimary, false),\n e: coalesce(cou.email, \"\")\n } END) AS clinopContactRows\nWITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw\nWITH sid, s,\n [row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e \u003c\u003e \"\"] AS pd_rows\nRETURN sid AS site_id, coalesce(s.name, \"\") AS site_name, pd_rows\n",
"queryParameters": "{deleted_status: \u0027Deleted\u0027, site_ids: [\u00279c081cd2-085b-4c6e-851e-abf432f301b4\u0027], study_id: \u00270a62f219-a803-482f-8973-ab67b1a3baf7\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.455Z",
"transactionId": 1776271.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (instance:WorkPlanInstance{tildaid:"e6c6652d-3cd8-4b9e-ac36-9df330acb222"})-[:WORKPLAN_TO_SITE]->(site:Site) RETURN site.tildaid as siteId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
MATCH (instance:WorkPlanInstance{tildaid:"e6c6652d-3cd8-4b9e-ac36-9df330acb222"})-[:WORKPLAN_TO_SITE]->(site:Site)
RETURN site.tildaid as siteId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "9B774BFC",
"id": "13640967",
"pageFaults": 0.0,
"pageHits": 414.0,
"planning": 0.0,
"query": "\n\t\tMATCH (instance:WorkPlanInstance{tildaid:\"e6c6652d-3cd8-4b9e-ac36-9df330acb222\"})-[:WORKPLAN_TO_SITE]-\u003e(site:Site)\n\t\tRETURN site.tildaid as siteId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.446Z",
"transactionId": 1756234.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (cfg:WorkplanCfg{tildaid:"37e5546c-d37f-4d97-a4ac-f5ebcc616248"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study) RETURN study.tildaid as studyId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
MATCH (cfg:WorkplanCfg{tildaid:"37e5546c-d37f-4d97-a4ac-f5ebcc616248"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study)
RETURN study.tildaid as studyId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "682A7B96",
"id": "17603104",
"pageFaults": 0.0,
"pageHits": 329.0,
"planning": 0.0,
"query": "\n\t\tMATCH (cfg:WorkplanCfg{tildaid:\"37e5546c-d37f-4d97-a4ac-f5ebcc616248\"})-[:WORKPLAN_CFG_TO_STUDY]-\u003e(study:Study)\n\t\tRETURN study.tildaid as studyId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.436Z",
"transactionId": 1776270.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc UNWIND $site_ids AS sid OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false}) OPTIONAL MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
UNWIND $site_ids AS sid
OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})
OPTIONAL MATCH (s)<-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]->(st:Study {tildaid: $study_id, delpending: false})
OPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]->(actor:Actor {delpending: false})-[:FOR_USER]->(u:User)
OPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]->(co:ClinOp {deltimestamp: 0})-[:FOR_USER]->(cou:User)
WITH sid, s,
collect(DISTINCT CASE
WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status <> $deleted_status) THEN {
t: pdc.type,
p: coalesce(pdc.isPrimary, false),
e: coalesce(u.email, "")
} END) AS actorContactRows,
collect(DISTINCT CASE
WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status <> $deleted_status) THEN {
t: copdc.type,
p: coalesce(copdc.isPrimary, false),
e: coalesce(cou.email, "")
} END) AS clinopContactRows
WITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw
WITH sid, s,
[row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e <> ""] AS pd_rows
RETURN sid AS site_id, coalesce(s.name, "") AS site_name, pd_rows
raw payload (15 fields)
{
"allocatedBytes": 19512.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "3832EC22",
"id": "13640966",
"pageFaults": 0.0,
"pageHits": 28.0,
"planning": 0.0,
"query": "\nUNWIND $site_ids AS sid\nOPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})\nOPTIONAL MATCH (s)\u003c-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]-\u003e(st:Study {tildaid: $study_id, delpending: false})\nOPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]-\u003e(actor:Actor {delpending: false})-[:FOR_USER]-\u003e(u:User)\nOPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]-\u003e(co:ClinOp {deltimestamp: 0})-[:FOR_USER]-\u003e(cou:User)\nWITH sid, s,\n collect(DISTINCT CASE\n WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status \u003c\u003e $deleted_status) THEN {\n t: pdc.type,\n p: coalesce(pdc.isPrimary, false),\n e: coalesce(u.email, \"\")\n } END) AS actorContactRows,\n collect(DISTINCT CASE\n WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status \u003c\u003e $deleted_status) THEN {\n t: copdc.type,\n p: coalesce(copdc.isPrimary, false),\n e: coalesce(cou.email, \"\")\n } END) AS clinopContactRows\nWITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw\nWITH sid, s,\n [row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e \u003c\u003e \"\"] AS pd_rows\nRETURN sid AS site_id, coalesce(s.name, \"\") AS site_name, pd_rows\n",
"queryParameters": "{deleted_status: \u0027Deleted\u0027, site_ids: [\u0027a6259678-9d0f-4311-8051-d1dca2333297\u0027], study_id: \u00270a62f219-a803-482f-8973-ab67b1a3baf7\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.427Z",
"transactionId": 1756233.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (instance:WorkPlanInstance{tildaid:"3dde6deb-a932-4d03-8c71-ce3a8e26bef7"})-[:WORKPLAN_TO_SITE]->(site:Site) RETURN site.tildaid as siteId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
MATCH (instance:WorkPlanInstance{tildaid:"3dde6deb-a932-4d03-8c71-ce3a8e26bef7"})-[:WORKPLAN_TO_SITE]->(site:Site)
RETURN site.tildaid as siteId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "9B774BFC",
"id": "17603103",
"pageFaults": 0.0,
"pageHits": 414.0,
"planning": 0.0,
"query": "\n\t\tMATCH (instance:WorkPlanInstance{tildaid:\"3dde6deb-a932-4d03-8c71-ce3a8e26bef7\"})-[:WORKPLAN_TO_SITE]-\u003e(site:Site)\n\t\tRETURN site.tildaid as siteId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.418Z",
"transactionId": 1776269.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (cfg:WorkplanCfg{tildaid:"a9f727b2-f56d-4267-b30f-8859577d46a9"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study) RETURN study.tildaid as studyId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
MATCH (cfg:WorkplanCfg{tildaid:"a9f727b2-f56d-4267-b30f-8859577d46a9"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study)
RETURN study.tildaid as studyId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "682A7B96",
"id": "13640965",
"pageFaults": 0.0,
"pageHits": 329.0,
"planning": 0.0,
"query": "\n\t\tMATCH (cfg:WorkplanCfg{tildaid:\"a9f727b2-f56d-4267-b30f-8859577d46a9\"})-[:WORKPLAN_CFG_TO_STUDY]-\u003e(study:Study)\n\t\tRETURN study.tildaid as studyId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.409Z",
"transactionId": 1756232.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc UNWIND $site_ids AS sid OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false}) OPTIONAL MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
UNWIND $site_ids AS sid
OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})
OPTIONAL MATCH (s)<-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]->(st:Study {tildaid: $study_id, delpending: false})
OPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]->(actor:Actor {delpending: false})-[:FOR_USER]->(u:User)
OPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]->(co:ClinOp {deltimestamp: 0})-[:FOR_USER]->(cou:User)
WITH sid, s,
collect(DISTINCT CASE
WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status <> $deleted_status) THEN {
t: pdc.type,
p: coalesce(pdc.isPrimary, false),
e: coalesce(u.email, "")
} END) AS actorContactRows,
collect(DISTINCT CASE
WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status <> $deleted_status) THEN {
t: copdc.type,
p: coalesce(copdc.isPrimary, false),
e: coalesce(cou.email, "")
} END) AS clinopContactRows
WITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw
WITH sid, s,
[row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e <> ""] AS pd_rows
RETURN sid AS site_id, coalesce(s.name, "") AS site_name, pd_rows
raw payload (15 fields)
{
"allocatedBytes": 19512.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "97FB2855",
"id": "17603102",
"pageFaults": 0.0,
"pageHits": 38.0,
"planning": 0.0,
"query": "\nUNWIND $site_ids AS sid\nOPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})\nOPTIONAL MATCH (s)\u003c-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]-\u003e(st:Study {tildaid: $study_id, delpending: false})\nOPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]-\u003e(actor:Actor {delpending: false})-[:FOR_USER]-\u003e(u:User)\nOPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]-\u003e(co:ClinOp {deltimestamp: 0})-[:FOR_USER]-\u003e(cou:User)\nWITH sid, s,\n collect(DISTINCT CASE\n WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status \u003c\u003e $deleted_status) THEN {\n t: pdc.type,\n p: coalesce(pdc.isPrimary, false),\n e: coalesce(u.email, \"\")\n } END) AS actorContactRows,\n collect(DISTINCT CASE\n WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status \u003c\u003e $deleted_status) THEN {\n t: copdc.type,\n p: coalesce(copdc.isPrimary, false),\n e: coalesce(cou.email, \"\")\n } END) AS clinopContactRows\nWITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw\nWITH sid, s,\n [row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e \u003c\u003e \"\"] AS pd_rows\nRETURN sid AS site_id, coalesce(s.name, \"\") AS site_name, pd_rows\n",
"queryParameters": "{deleted_status: \u0027Deleted\u0027, site_ids: [\u00279c081cd2-085b-4c6e-851e-abf432f301b4\u0027], study_id: \u00270a62f219-a803-482f-8973-ab67b1a3baf7\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.399Z",
"transactionId": 1776268.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (instance:WorkPlanInstance{tildaid:"4102804a-71a2-48ef-8acf-e1d9a4321996"})-[:WORKPLAN_TO_SITE]->(site:Site) RETURN site.tildaid as siteId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
MATCH (instance:WorkPlanInstance{tildaid:"4102804a-71a2-48ef-8acf-e1d9a4321996"})-[:WORKPLAN_TO_SITE]->(site:Site)
RETURN site.tildaid as siteId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "9B774BFC",
"id": "13640964",
"pageFaults": 0.0,
"pageHits": 434.0,
"planning": 0.0,
"query": "\n\t\tMATCH (instance:WorkPlanInstance{tildaid:\"4102804a-71a2-48ef-8acf-e1d9a4321996\"})-[:WORKPLAN_TO_SITE]-\u003e(site:Site)\n\t\tRETURN site.tildaid as siteId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.389Z",
"transactionId": 1756231.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (cfg:WorkplanCfg{tildaid:"a9f727b2-f56d-4267-b30f-8859577d46a9"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study) RETURN study.tildaid as studyId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
MATCH (cfg:WorkplanCfg{tildaid:"a9f727b2-f56d-4267-b30f-8859577d46a9"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study)
RETURN study.tildaid as studyId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "682A7B96",
"id": "17603101",
"pageFaults": 0.0,
"pageHits": 329.0,
"planning": 0.0,
"query": "\n\t\tMATCH (cfg:WorkplanCfg{tildaid:\"a9f727b2-f56d-4267-b30f-8859577d46a9\"})-[:WORKPLAN_CFG_TO_STUDY]-\u003e(study:Study)\n\t\tRETURN study.tildaid as studyId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.378Z",
"transactionId": 1776267.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc UNWIND $site_ids AS sid OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false}) OPTIONAL MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
UNWIND $site_ids AS sid
OPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})
OPTIONAL MATCH (s)<-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]->(st:Study {tildaid: $study_id, delpending: false})
OPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]->(actor:Actor {delpending: false})-[:FOR_USER]->(u:User)
OPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]->(co:ClinOp {deltimestamp: 0})-[:FOR_USER]->(cou:User)
WITH sid, s,
collect(DISTINCT CASE
WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status <> $deleted_status) THEN {
t: pdc.type,
p: coalesce(pdc.isPrimary, false),
e: coalesce(u.email, "")
} END) AS actorContactRows,
collect(DISTINCT CASE
WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status <> $deleted_status) THEN {
t: copdc.type,
p: coalesce(copdc.isPrimary, false),
e: coalesce(cou.email, "")
} END) AS clinopContactRows
WITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw
WITH sid, s,
[row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e <> ""] AS pd_rows
RETURN sid AS site_id, coalesce(s.name, "") AS site_name, pd_rows
raw payload (15 fields)
{
"allocatedBytes": 19512.0,
"cpu": 2.0,
"elapsedTimeMs": 2.0,
"executionPlanCacheKeyHash": "3832EC22",
"id": "13640963",
"pageFaults": 0.0,
"pageHits": 118.0,
"planning": 1.0,
"query": "\nUNWIND $site_ids AS sid\nOPTIONAL MATCH (s:Site {tildaid: sid, delpending: false})\nOPTIONAL MATCH (s)\u003c-[:PLAN_DEFINITION_TO_SITE]-(pd:DslPlanDefinition {delpending: false})-[:PLAN_DEFINITION_TO_STUDY]-\u003e(st:Study {tildaid: $study_id, delpending: false})\nOPTIONAL MATCH (pd)-[pdc:PLAN_DEFINITION_TO_CONTACT]-\u003e(actor:Actor {delpending: false})-[:FOR_USER]-\u003e(u:User)\nOPTIONAL MATCH (pd)-[copdc:PLAN_DEFINITION_TO_CLINOP_CONTACT]-\u003e(co:ClinOp {deltimestamp: 0})-[:FOR_USER]-\u003e(cou:User)\nWITH sid, s,\n collect(DISTINCT CASE\n WHEN pdc IS NOT NULL AND actor IS NOT NULL AND (u IS NULL OR u.status \u003c\u003e $deleted_status) THEN {\n t: pdc.type,\n p: coalesce(pdc.isPrimary, false),\n e: coalesce(u.email, \"\")\n } END) AS actorContactRows,\n collect(DISTINCT CASE\n WHEN copdc IS NOT NULL AND co IS NOT NULL AND (cou IS NULL OR cou.status \u003c\u003e $deleted_status) THEN {\n t: copdc.type,\n p: coalesce(copdc.isPrimary, false),\n e: coalesce(cou.email, \"\")\n } END) AS clinopContactRows\nWITH sid, s, actorContactRows + clinopContactRows AS pdContactRowsRaw\nWITH sid, s,\n [row IN pdContactRowsRaw WHERE row IS NOT NULL AND row.t IS NOT NULL AND row.e IS NOT NULL AND row.e \u003c\u003e \"\"] AS pd_rows\nRETURN sid AS site_id, coalesce(s.name, \"\") AS site_name, pd_rows\n",
"queryParameters": "{deleted_status: \u0027Deleted\u0027, site_ids: [\u0027cec6713e-0087-4942-91db-316352bbca2c\u0027], study_id: \u00275b971f19-ded8-4c5d-8649-5b2a96841d67\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.368Z",
"transactionId": 1756230.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (instance:WorkPlanInstance{tildaid:"4104335e-49f9-4396-a635-7a4724b2c2cf"})-[:WORKPLAN_TO_SITE]->(site:Site) RETURN site.tildaid as siteId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
MATCH (instance:WorkPlanInstance{tildaid:"4104335e-49f9-4396-a635-7a4724b2c2cf"})-[:WORKPLAN_TO_SITE]->(site:Site)
RETURN site.tildaid as siteId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "9B774BFC",
"id": "17603100",
"pageFaults": 0.0,
"pageHits": 415.0,
"planning": 0.0,
"query": "\n\t\tMATCH (instance:WorkPlanInstance{tildaid:\"4104335e-49f9-4396-a635-7a4724b2c2cf\"})-[:WORKPLAN_TO_SITE]-\u003e(site:Site)\n\t\tRETURN site.tildaid as siteId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.356Z",
"transactionId": 1776266.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH (cfg:WorkplanCfg{tildaid:"0590e24b-65f6-4c37-b293-8899478c233a"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study) RETURN study.tildaid as studyId
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
MATCH (cfg:WorkplanCfg{tildaid:"0590e24b-65f6-4c37-b293-8899478c233a"})-[:WORKPLAN_CFG_TO_STUDY]->(study:Study)
RETURN study.tildaid as studyId
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 1.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "682A7B96",
"id": "13640962",
"pageFaults": 0.0,
"pageHits": 347.0,
"planning": 0.0,
"query": "\n\t\tMATCH (cfg:WorkplanCfg{tildaid:\"0590e24b-65f6-4c37-b293-8899478c233a\"})-[:WORKPLAN_CFG_TO_STUDY]-\u003e(study:Study)\n\t\tRETURN study.tildaid as studyId\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.346Z",
"transactionId": 1756229.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-1-dev-0
query
MATCH (cfg:WorkplanCfg)-[:WORKPLAN_CFG_TO_INSTANCE]->(wp:WorkPlanInstance)-[:WORKPLAN_INSTANCE_TO_MILESTONE]->(m:WorkPlanMilestone)-[:REL_WORKPLAN_INSTANCE_MILESTONE_TO_ITEM]->(item:WorkplanInstanceMilestoneItem) WHERE item.itemType = "Workorder" AND coalesce(item.workOrderActivationFailedAt, 0) > 0 AND coalesce(item.workOrderActivationErrorCode, "") = "NO_RECIPIENTS_FOR_SITE_CONTACT_CATEGORY" AND coalesce(item.workOrderCompletedAt, 0) = 0 AND coalesce(item.workOrderResolvedAt, 0) = 0 AND coalesce(item.skippedAt, 0) = 0 AND coalesce(item.notApplicableAt, 0) = 0 AND coalesce(item.workOrderId, "") <> "" RETURN cfg.tildaid AS cfgId, wp.tildaid AS instanceId, item.tildaid AS itemId, item.workOrderId AS workOrderId, coalesce(item.itemConfig, "") AS itemConfig
raw payload (15 fields)
{
"allocatedBytes": 336.0,
"cpu": 5.0,
"elapsedTimeMs": 6.0,
"executionPlanCacheKeyHash": "C9113EA6",
"id": "17603099",
"pageFaults": 0.0,
"pageHits": 7269.0,
"planning": 0.0,
"query": "\n\t\tMATCH (cfg:WorkplanCfg)-[:WORKPLAN_CFG_TO_INSTANCE]-\u003e(wp:WorkPlanInstance)-[:WORKPLAN_INSTANCE_TO_MILESTONE]-\u003e(m:WorkPlanMilestone)-[:REL_WORKPLAN_INSTANCE_MILESTONE_TO_ITEM]-\u003e(item:WorkplanInstanceMilestoneItem)\n\t\tWHERE item.itemType = \"Workorder\"\n\t\t AND coalesce(item.workOrderActivationFailedAt, 0) \u003e 0\n\t\t AND coalesce(item.workOrderActivationErrorCode, \"\") = \"NO_RECIPIENTS_FOR_SITE_CONTACT_CATEGORY\"\n\t\t AND coalesce(item.workOrderCompletedAt, 0) = 0\n\t\t AND coalesce(item.workOrderResolvedAt, 0) = 0\n\t\t AND coalesce(item.skippedAt, 0) = 0 AND coalesce(item.notApplicableAt, 0) = 0\n\t\t AND coalesce(item.workOrderId, \"\") \u003c\u003e \"\"\n\t\tRETURN cfg.tildaid AS cfgId, wp.tildaid AS instanceId, item.tildaid AS itemId,\n\t\t item.workOrderId AS workOrderId, coalesce(item.itemConfig, \"\") AS itemConfig\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:18.335Z",
"transactionId": 1776265.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc MATCH...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-3-dev-0
query
MATCH (wp:WorkPlanInstance)-[:WORKPLAN_INSTANCE_TO_MILESTONE]->(:WorkPlanMilestone)-[:REL_WORKPLAN_INSTANCE_MILESTONE_TO_ITEM]->(item:WorkplanInstanceMilestoneItem) WHERE item.itemType = "Workorder" AND wp.state <> "archived" AND coalesce(item.workOrderId, "") <> "" AND coalesce(item.activationPending, false) = true AND coalesce(item.activationEligible, false) = true AND coalesce(item.activateRequestedAt, 0) = 0 RETURN item.tildaid AS id LIMIT 80
raw payload (15 fields)
{
"allocatedBytes": 336.0,
"cpu": 7.0,
"elapsedTimeMs": 7.0,
"executionPlanCacheKeyHash": "32028411",
"id": "13640961",
"pageFaults": 0.0,
"pageHits": 7580.0,
"planning": 0.0,
"query": "\n\t\tMATCH (wp:WorkPlanInstance)-[:WORKPLAN_INSTANCE_TO_MILESTONE]-\u003e(:WorkPlanMilestone)-[:REL_WORKPLAN_INSTANCE_MILESTONE_TO_ITEM]-\u003e(item:WorkplanInstanceMilestoneItem)\n\t\tWHERE item.itemType = \"Workorder\"\n\t\t AND wp.state \u003c\u003e \"archived\"\n\t\t AND coalesce(item.workOrderId, \"\") \u003c\u003e \"\"\n\t\t AND coalesce(item.activationPending, false) = true\n\t\t AND coalesce(item.activationEligible, false) = true\n\t\t AND coalesce(item.activateRequestedAt, 0) = 0\n\t\tRETURN item.tildaid AS id\n\t\tLIMIT 80\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:18.320Z",
"transactionId": 1756228.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC DEBUG workplansvc TransactionID commit
time2026-07-27 02:17:18 UTC
severityDEBUG
serviceworkplansvc
sourcetildadb/api.go:2575
clustermaster
versionunknown
podworkplansvc-75f7d8dcb6-jxnsg
message
TransactionID commit
raw payload (8 fields)
{
"caller": "tildadb/api.go:2575",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "TransactionID commit",
"service": "workplansvc",
"timestamp": "2026-07-27T02:17:18.307Z",
"transactionID": "FB:kcwQc8qrjECqRtOxBB1HjVmAmsoAPpltkA==",
"version": "unknown"
}31s ago2026-07-27 02:17:18 UTC neo4j workplansvc RETURN EXISTS { MATCH (inst:WorkPlanInstance) WHERE coalesce(inst.progressSummariesPending, false) = true } AS progressPending, ...
time2026-07-27 02:17:18 UTC
severityINFO
serviceworkplansvc
clustermaster
podserver-2-dev-0
query
RETURN EXISTS {
MATCH (inst:WorkPlanInstance)
WHERE coalesce(inst.progressSummariesPending, false) = true
} AS progressPending,
EXISTS {
MATCH (item:WorkplanInstanceMilestoneItem)
WHERE item.itemType = "Workorder"
AND coalesce(item.workOrderId, "") <> ""
AND coalesce(item.activationPending, false) = true
AND coalesce(item.activationEligible, false) = true
AND coalesce(item.activateRequestedAt, 0) = 0
} AS activationPending,
EXISTS {
MATCH (cfg:WorkplanCfg)
WHERE coalesce(cfg.workOrderEmailAutoSendTransitionPending, false) = true
} AS autosendTransition,
EXISTS {
MATCH (cfg:WorkplanCfg)-[:WORKPLAN_CFG_TO_INSTANCE]->(wp:WorkPlanInstance)-[:WORKPLAN_INSTANCE_TO_MILESTONE]->(:WorkPlanMilestone)-[:REL_WORKPLAN_INSTANCE_MILESTONE_TO_ITEM]->(item:WorkplanInstanceMilestoneItem)
WHERE item.itemType = "Workorder"
AND coalesce(item.workOrderActivationFailedAt, 0) > 0
AND coalesce(item.workOrderActivationErrorCode, "") = "NO_RECIPIENTS_FOR_SITE_CONTACT_CATEGORY"
AND coalesce(item.workOrderCompletedAt, 0) = 0
AND coalesce(item.workOrderResolvedAt, 0) = 0
AND coalesce(item.skippedAt, 0) = 0
AND coalesce(item.notApplicableAt, 0) = 0
AND coalesce(item.workOrderId, "") <> ""
} AS recipientRetry,
EXISTS {
MATCH (wp2:WorkPlanInstance)
WHERE wp2.instanceReadyDeterminationState = "pending"
} AS readyDetermination
raw payload (15 fields)
{
"allocatedBytes": 102656.0,
"cpu": 4.0,
"elapsedTimeMs": 5.0,
"executionPlanCacheKeyHash": "5CC92BFF",
"id": "25356768",
"pageFaults": 0.0,
"pageHits": 2252.0,
"planning": 0.0,
"query": "\n\t\tRETURN EXISTS {\n\t\t\tMATCH (inst:WorkPlanInstance)\n\t\t\tWHERE coalesce(inst.progressSummariesPending, false) = true\n\t\t} AS progressPending,\n\t\t EXISTS {\n\t\t MATCH (item:WorkplanInstanceMilestoneItem)\n\t\t WHERE item.itemType = \"Workorder\"\n\t\t AND coalesce(item.workOrderId, \"\") \u003c\u003e \"\"\n\t\t AND coalesce(item.activationPending, false) = true\n\t\t AND coalesce(item.activationEligible, false) = true\n\t\t AND coalesce(item.activateRequestedAt, 0) = 0\n\t\t } AS activationPending,\n\t\t EXISTS {\n\t\t MATCH (cfg:WorkplanCfg)\n\t\t WHERE coalesce(cfg.workOrderEmailAutoSendTransitionPending, false) = true\n\t\t } AS autosendTransition,\n\t\t EXISTS {\n\t\t MATCH (cfg:WorkplanCfg)-[:WORKPLAN_CFG_TO_INSTANCE]-\u003e(wp:WorkPlanInstance)-[:WORKPLAN_INSTANCE_TO_MILESTONE]-\u003e(:WorkPlanMilestone)-[:REL_WORKPLAN_INSTANCE_MILESTONE_TO_ITEM]-\u003e(item:WorkplanInstanceMilestoneItem)\n\t\t WHERE item.itemType = \"Workorder\"\n\t\t AND coalesce(item.workOrderActivationFailedAt, 0) \u003e 0\n\t\t AND coalesce(item.workOrderActivationErrorCode, \"\") = \"NO_RECIPIENTS_FOR_SITE_CONTACT_CATEGORY\"\n\t\t AND coalesce(item.workOrderCompletedAt, 0) = 0\n\t\t AND coalesce(item.workOrderResolvedAt, 0) = 0\n\t\t AND coalesce(item.skippedAt, 0) = 0\n\t\t AND coalesce(item.notApplicableAt, 0) = 0\n\t\t AND coalesce(item.workOrderId, \"\") \u003c\u003e \"\"\n\t\t } AS recipientRetry,\n\t\t EXISTS {\n\t\t MATCH (wp2:WorkPlanInstance)\n\t\t WHERE wp2.instanceReadyDeterminationState = \"pending\"\n\t\t } AS readyDetermination\n\t",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tGo Driver/5.20.0\t\tclient/10.129.4.159:45492\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:18.305Z",
"transactionId": 12246576.0,
"waiting": 0.0
}31s ago2026-07-27 02:17:18 UTC DEBUG workplansvc TransactionID
time2026-07-27 02:17:18 UTC
severityDEBUG
serviceworkplansvc
sourcetildadb/api.go:2482
clustermaster
versionunknown
podworkplansvc-75f7d8dcb6-jxnsg
message
TransactionID
raw payload (8 fields)
{
"caller": "tildadb/api.go:2482",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "TransactionID",
"service": "workplansvc",
"timestamp": "2026-07-27T02:17:18.299Z",
"transactionID": "",
"version": "unknown"
}32s ago2026-07-27 02:17:17 UTC neo4j advpsvc match(a:AdvRateRule{deleted:true})-[r]-(b) with distinct a return a.portalorgid, a.tildaid, a.ruletype limit 10
time2026-07-27 02:17:17 UTC
severityINFO
serviceadvpsvc
clustermaster
podserver-1-dev-0
query
match(a:AdvRateRule{deleted:true})-[r]-(b)
with distinct a
return a.portalorgid, a.tildaid, a.ruletype
limit 10
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 2.0,
"elapsedTimeMs": 2.0,
"executionPlanCacheKeyHash": "AFAFBFFB",
"id": "17603088",
"pageFaults": 0.0,
"pageHits": 1146.0,
"planning": 0.0,
"query": "match(a:AdvRateRule{deleted:true})-[r]-(b) with distinct a return a.portalorgid, a.tildaid, a.ruletype limit 10",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:38942\tserver/10.173.2.71:7688\u003e",
"timestamp": "2026-07-27T02:17:17.145Z",
"transactionId": 1776264.0,
"waiting": 0.0
}33s ago2026-07-27 02:17:16 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:16 UTC
severityERROR
clustermaster
podworkplansvc-75f7d8dcb6-jxnsg
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
33s ago2026-07-27 02:17:16 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:16 UTC
severityERROR
clustermaster
podstudiosvc-7649ffd596-dwzsc
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
34s ago2026-07-27 02:17:15 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:15 UTC
severityINFO
clustermaster
podrag-agent-57879dd94f-l9nz7
34s ago2026-07-27 02:17:15 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:15 UTC
severityINFO
clustermaster
podlitellm-f54655c99-tt2pg
35s ago2026-07-27 02:17:14 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:14 UTC
severityERROR
clustermaster
podschedsvc-786465b756-5smng
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
35s ago2026-07-27 02:17:14 UTC neo4j virtual-assistant RETURN 1 as health_check
time2026-07-27 02:17:14 UTC
severityINFO
servicevirtual-assistant
clustermaster
trace182626962e997e88f289fbedd4d8e706
span0599adb40378beb3
podserver-2-dev-0
query
RETURN 1 as health_check
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "745CE4BF",
"id": "25356012",
"pageFaults": 0.0,
"pageHits": 0.0,
"planning": 0.0,
"query": "RETURN 1 as health_check",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.201:47754\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:14.233Z",
"transactionId": 12246574.0,
"waiting": 0.0
}35s ago2026-07-27 02:17:14 UTC neo4j virtual-assistant RETURN 1
time2026-07-27 02:17:14 UTC
severityINFO
servicevirtual-assistant
clustermaster
trace182626962e997e88f289fbedd4d8e706
span0599adb40378beb3
podserver-2-dev-0
query
RETURN 1
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "4CADEF45",
"id": "25356009",
"pageFaults": 0.0,
"pageHits": 0.0,
"planning": 0.0,
"query": "RETURN 1",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.201:47754\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:14.226Z",
"transactionId": 12246573.0,
"waiting": 0.0
}35s ago2026-07-27 02:17:14 UTC DEBUG virtual-assistant Session attributes: ['_auto_result', '_bookmark_manager', '_bookmarks', '_check_state', '_closed', '_config', '_connect', '_connection',...
time2026-07-27 02:17:14 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/neo4j_client.py:850
clustermaster
versionunknown
trace182626962e997e88f289fbedd4d8e706
span0599adb40378beb3
podvirtual-assistant-65b975d66b-l8wpw
message
Session attributes: ['_auto_result', '_bookmark_manager', '_bookmarks', '_check_state', '_closed', '_config', '_connect', '_connection', '_connection_access_mode', '_disconnect', '_get_bookmarks', '_get_routing_target_database', '_get_server_info', '_handle_cancellation', '_initial_bookmarks', '_initialize_bookmarks', '_last_cache_key', '_last_from_bookmark_manager', '_make_db_resolution_callback', '_non_concurrent_iter', '_non_concurrent_method', '_open_transaction', '_pinned_database', '_pipelined_begin', '_pool', '_resolve_session_auth', '_result_closed', '_result_error', '_run_transaction', '_set_pinned_database', '_state_failed', '_transaction', '_transaction_cancel_handler', '_transaction_closed_handler', '_transaction_error_handler', '_update_bookmark', '_update_bookmarks', '_verify_authentication', 'begin_transaction', 'close', 'closed', 'execute_read', 'execute_write', 'last_bookmark', 'last_bookmarks', 'read_transaction', 'run', 'write_transaction']
raw payload (9 fields)
{
"caller": "src/neo4j_client.py:850",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Session attributes: [\u0027_auto_result\u0027, \u0027_bookmark_manager\u0027, \u0027_bookmarks\u0027, \u0027_check_state\u0027, \u0027_closed\u0027, \u0027_config\u0027, \u0027_connect\u0027, \u0027_connection\u0027, \u0027_connection_access_mode\u0027, \u0027_disconnect\u0027, \u0027_get_bookmarks\u0027, \u0027_get_routing_target_database\u0027, \u0027_get_server_info\u0027, \u0027_handle_cancellation\u0027, \u0027_initial_bookmarks\u0027, \u0027_initialize_bookmarks\u0027, \u0027_last_cache_key\u0027, \u0027_last_from_bookmark_manager\u0027, \u0027_make_db_resolution_callback\u0027, \u0027_non_concurrent_iter\u0027, \u0027_non_concurrent_method\u0027, \u0027_open_transaction\u0027, \u0027_pinned_database\u0027, \u0027_pipelined_begin\u0027, \u0027_pool\u0027, \u0027_resolve_session_auth\u0027, \u0027_result_closed\u0027, \u0027_result_error\u0027, \u0027_run_transaction\u0027, \u0027_set_pinned_database\u0027, \u0027_state_failed\u0027, \u0027_transaction\u0027, \u0027_transaction_cancel_handler\u0027, \u0027_transaction_closed_handler\u0027, \u0027_transaction_error_handler\u0027, \u0027_update_bookmark\u0027, \u0027_update_bookmarks\u0027, \u0027_verify_authentication\u0027, \u0027begin_transaction\u0027, \u0027close\u0027, \u0027closed\u0027, \u0027execute_read\u0027, \u0027execute_write\u0027, \u0027last_bookmark\u0027, \u0027last_bookmarks\u0027, \u0027read_transaction\u0027, \u0027run\u0027, \u0027write_transaction\u0027]",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:14.217Z",
"version": "unknown"
}35s ago2026-07-27 02:17:14 UTC DEBUG virtual-assistant Pool attributes: ['_abc_impl', '_acquire', '_acquire_from_pool', '_acquire_from_pool_checked', '_acquire_new_later', '_add_connections',...
time2026-07-27 02:17:14 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/neo4j_client.py:796
clustermaster
versionunknown
trace182626962e997e88f289fbedd4d8e706
span0599adb40378beb3
podvirtual-assistant-65b975d66b-l8wpw
message
Pool attributes: ['_abc_impl', '_acquire', '_acquire_from_pool', '_acquire_from_pool_checked', '_acquire_new_later', '_add_connections', '_close_connections', '_re_auth_connection', '_remove_connection', '_remove_connections', '_select_address', '_ssr_feature_tracker', '_update_routing_table_from', 'acquire', 'address', 'close', 'cond', 'connections', 'connections_reservations', 'deactivate', 'ensure_routing_table_is_fresh', 'fetch_routing_info', 'fetch_routing_table', 'get_auth', 'get_or_create_routing_table', 'get_routing_table', 'home_db_cache', 'in_use_connection_count', 'is_direct_pool', 'kill_and_release', 'lock', 'mark_all_stale', 'on_neo4j_error', 'on_write_failure', 'open', 'opener', 'pool_config', 'refresh_lock', 'release', 'routing_tables', 'ssr_enabled', 'update_connection_pool', 'update_routing_table', 'workspace_config']
raw payload (9 fields)
{
"caller": "src/neo4j_client.py:796",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Pool attributes: [\u0027_abc_impl\u0027, \u0027_acquire\u0027, \u0027_acquire_from_pool\u0027, \u0027_acquire_from_pool_checked\u0027, \u0027_acquire_new_later\u0027, \u0027_add_connections\u0027, \u0027_close_connections\u0027, \u0027_re_auth_connection\u0027, \u0027_remove_connection\u0027, \u0027_remove_connections\u0027, \u0027_select_address\u0027, \u0027_ssr_feature_tracker\u0027, \u0027_update_routing_table_from\u0027, \u0027acquire\u0027, \u0027address\u0027, \u0027close\u0027, \u0027cond\u0027, \u0027connections\u0027, \u0027connections_reservations\u0027, \u0027deactivate\u0027, \u0027ensure_routing_table_is_fresh\u0027, \u0027fetch_routing_info\u0027, \u0027fetch_routing_table\u0027, \u0027get_auth\u0027, \u0027get_or_create_routing_table\u0027, \u0027get_routing_table\u0027, \u0027home_db_cache\u0027, \u0027in_use_connection_count\u0027, \u0027is_direct_pool\u0027, \u0027kill_and_release\u0027, \u0027lock\u0027, \u0027mark_all_stale\u0027, \u0027on_neo4j_error\u0027, \u0027on_write_failure\u0027, \u0027open\u0027, \u0027opener\u0027, \u0027pool_config\u0027, \u0027refresh_lock\u0027, \u0027release\u0027, \u0027routing_tables\u0027, \u0027ssr_enabled\u0027, \u0027update_connection_pool\u0027, \u0027update_routing_table\u0027, \u0027workspace_config\u0027]",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:14.217Z",
"version": "unknown"
}35s ago2026-07-27 02:17:14 UTC DEBUG virtual-assistant Driver attributes: ['_check_state', '_closed', '_default_workspace_config', '_get_server_info', '_initial_addresses', '_pool',...
time2026-07-27 02:17:14 UTC
severityDEBUG
servicevirtual-assistant
sourcesrc/neo4j_client.py:787
clustermaster
versionunknown
trace182626962e997e88f289fbedd4d8e706
span0599adb40378beb3
podvirtual-assistant-65b975d66b-l8wpw
message
Driver attributes: ['_check_state', '_closed', '_default_workspace_config', '_get_server_info', '_initial_addresses', '_pool', '_prepare_session_config', '_query_bookmark_manager', '_read_session_config', '_session', 'close', 'default_host', 'default_port', 'default_targets', 'encrypted', 'execute_query', 'execute_query_bookmark_manager', 'get_server_info', 'initial_addresses', 'open', 'parse_targets', 'session', 'supports_multi_db', 'supports_session_auth', 'verify_authentication', 'verify_connectivity']
raw payload (9 fields)
{
"caller": "src/neo4j_client.py:787",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Driver attributes: [\u0027_check_state\u0027, \u0027_closed\u0027, \u0027_default_workspace_config\u0027, \u0027_get_server_info\u0027, \u0027_initial_addresses\u0027, \u0027_pool\u0027, \u0027_prepare_session_config\u0027, \u0027_query_bookmark_manager\u0027, \u0027_read_session_config\u0027, \u0027_session\u0027, \u0027close\u0027, \u0027default_host\u0027, \u0027default_port\u0027, \u0027default_targets\u0027, \u0027encrypted\u0027, \u0027execute_query\u0027, \u0027execute_query_bookmark_manager\u0027, \u0027get_server_info\u0027, \u0027initial_addresses\u0027, \u0027open\u0027, \u0027parse_targets\u0027, \u0027session\u0027, \u0027supports_multi_db\u0027, \u0027supports_session_auth\u0027, \u0027verify_authentication\u0027, \u0027verify_connectivity\u0027]",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:14.217Z",
"version": "unknown"
}35s ago2026-07-27 02:17:14 UTC DEBUG virtual-assistant 🔍 AUTH_DEBUG: Path in UNPROTECTED_ENDPOINTS: True
time2026-07-27 02:17:14 UTC
severityDEBUG
servicevirtual-assistant
sourceapi/api.py:491
clustermaster
versionunknown
trace182626962e997e88f289fbedd4d8e706
span0599adb40378beb3
podvirtual-assistant-65b975d66b-l8wpw
message
🔍 AUTH_DEBUG: Path in UNPROTECTED_ENDPOINTS: True
raw payload (9 fields)
{
"caller": "api/api.py:491",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\ud83d\udd0d AUTH_DEBUG: Path in UNPROTECTED_ENDPOINTS: True",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:14.213Z",
"version": "unknown"
}35s ago2026-07-27 02:17:14 UTC DEBUG virtual-assistant 🔍 AUTH_DEBUG: Method: GET
time2026-07-27 02:17:14 UTC
severityDEBUG
servicevirtual-assistant
sourceapi/api.py:489
clustermaster
versionunknown
trace182626962e997e88f289fbedd4d8e706
span0599adb40378beb3
podvirtual-assistant-65b975d66b-l8wpw
message
🔍 AUTH_DEBUG: Method: GET
raw payload (9 fields)
{
"caller": "api/api.py:489",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\ud83d\udd0d AUTH_DEBUG: Method: GET",
"method": "GET",
"path": "/health",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:14.213Z",
"version": "unknown"
}37s ago2026-07-27 02:17:12 UTC ERROR observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
filter by:
severity≥ERROR
time2026-07-27 02:17:12 UTC
severityERROR
clustermaster
podregsvc-766cff9b49-cfs28
message
observability: level watcher could not stat config file /etc/config/observability.yaml: stat /etc/config/observability.yaml: no such file or directory
37s ago2026-07-27 02:17:12 UTC neo4j advpsvc match(a:AdvRateRule{deleted:true})-[r]-(b) with distinct a return a.portalorgid, a.tildaid, a.ruletype limit 10
time2026-07-27 02:17:12 UTC
severityINFO
serviceadvpsvc
clustermaster
podserver-3-dev-0
query
match(a:AdvRateRule{deleted:true})-[r]-(b)
with distinct a
return a.portalorgid, a.tildaid, a.ruletype
limit 10
raw payload (15 fields)
{
"allocatedBytes": 328.0,
"cpu": 2.0,
"elapsedTimeMs": 2.0,
"executionPlanCacheKeyHash": "AFAFBFFB",
"id": "13640906",
"pageFaults": 0.0,
"pageHits": 1146.0,
"planning": 0.0,
"query": "match(a:AdvRateRule{deleted:true})-[r]-(b) with distinct a return a.portalorgid, a.tildaid, a.ruletype limit 10",
"queryParameters": "{}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.0.8:53954\tserver/10.173.0.201:7688\u003e",
"timestamp": "2026-07-27T02:17:12.133Z",
"transactionId": 1756227.0,
"waiting": 0.0
}38s ago2026-07-27 02:17:11 UTC DEBUG docproc Reported pending workload
time2026-07-27 02:17:11 UTC
severityDEBUG
servicedocproc
sourcejobs/hpa_pending_workload.py:176
clustermaster
version0.1.0
poddocproc-7bc76669-ljh8h
message
Reported pending workload
raw payload (15 fields)
{
"backlog_capped": 0.0,
"caller": "jobs/hpa_pending_workload.py:176",
"cluster": "master",
"component": "hpa_pending_workload",
"environment": "DEVELOPMENT",
"in_progress_count": 0.0,
"message": "Reported pending workload",
"num_replicas": 1.0,
"recovery_workload": 0.0,
"service": "docproc",
"signal": 0.0,
"timestamp": "2026-07-27T02:17:11.793Z",
"total_workload": 0.0,
"unacked": 0.0,
"version": "0.1.0"
}38s ago2026-07-27 02:17:11 UTC DEBUG docproc Pub/Sub num_unacked result: project_id=tilda-trial-automation subscription_id_in_filter=tilda-document-master-docproc-sub num_series=1 total=0
time2026-07-27 02:17:11 UTC
severityDEBUG
servicedocproc
sourcejobs/cloud_monitoring_metrics.py:296
clustermaster
version0.1.0
poddocproc-7bc76669-ljh8h
message
Pub/Sub num_unacked result: project_id=tilda-trial-automation subscription_id_in_filter=tilda-document-master-docproc-sub num_series=1 total=0
raw payload (7 fields)
{
"caller": "jobs/cloud_monitoring_metrics.py:296",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "Pub/Sub num_unacked result: project_id=tilda-trial-automation subscription_id_in_filter=tilda-document-master-docproc-sub num_series=1 total=0",
"service": "docproc",
"timestamp": "2026-07-27T02:17:11.702Z",
"version": "0.1.0"
}38s ago2026-07-27 02:17:11 UTC neo4j docproc MATCH (o:Organization{orgType:"CRO"})-[:DOC_TO_ORG]-(d:Document)-[:INCLUDES]-(f:Folder) WHERE f.name IN ['Staging', 'Pre-Staging'] ...
time2026-07-27 02:17:11 UTC
severityINFO
servicedocproc
clustermaster
podserver-2-dev-0
query
MATCH (o:Organization{orgType:"CRO"})-[:DOC_TO_ORG]-(d:Document)-[:INCLUDES]-(f:Folder)
WHERE f.name IN ['Staging', 'Pre-Staging']
AND d.delpending = false AND d.aiEnabled = true AND d.studyId <> ""
AND d.primaryVersionId IS NOT NULL AND d.primaryVersionId <> ""
OPTIONAL MATCH (d)<-[:AI_RUN_TO_DOCUMENT_LATEST]-(ai:AIRun)
WITH o, d, ai
ORDER BY d.tildaid, COALESCE(ai.updatedat, ai.createdat) DESC
WITH o, d, collect(ai)[0] AS latest_ai
WHERE (
latest_ai IS NULL
OR latest_ai.status = "aborted"
OR (
latest_ai.status = "failed"
AND COALESCE(latest_ai.auto_retry_count, 0) < $max_retries
AND COALESCE(latest_ai.updatedat, latest_ai.createdat) < $threshold_ms
)
)
WITH d
RETURN count(d) AS total
raw payload (15 fields)
{
"allocatedBytes": 7666360.0,
"cpu": 168.0,
"elapsedTimeMs": 169.0,
"executionPlanCacheKeyHash": "590286C5",
"id": "25355600",
"pageFaults": 0.0,
"pageHits": 156362.0,
"planning": 0.0,
"query": "\n MATCH (o:Organization{orgType:\"CRO\"})-[:DOC_TO_ORG]-(d:Document)-[:INCLUDES]-(f:Folder)\n WHERE f.name IN [\u0027Staging\u0027, \u0027Pre-Staging\u0027]\n AND d.delpending = false AND d.aiEnabled = true AND d.studyId \u003c\u003e \"\"\n AND d.primaryVersionId IS NOT NULL AND d.primaryVersionId \u003c\u003e \"\"\n OPTIONAL MATCH (d)\u003c-[:AI_RUN_TO_DOCUMENT_LATEST]-(ai:AIRun)\n WITH o, d, ai\n ORDER BY d.tildaid, COALESCE(ai.updatedat, ai.createdat) DESC\n WITH o, d, collect(ai)[0] AS latest_ai\n WHERE (\n latest_ai IS NULL\n OR latest_ai.status = \"aborted\"\n OR (\n latest_ai.status = \"failed\"\n AND COALESCE(latest_ai.auto_retry_count, 0) \u003c $max_retries\n AND COALESCE(latest_ai.updatedat, latest_ai.createdat) \u003c $threshold_ms\n )\n )\n WITH d\n RETURN count(d) AS total\n ",
"queryParameters": "{max_retries: 5, threshold_ms: 1785117731299}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.2.71:49876\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:11.473Z",
"transactionId": 12246572.0,
"waiting": 0.0
}38s ago2026-07-27 02:17:11 UTC neo4j docproc MATCH (ai:AIRun)-[:AI_RUN_TO_DOCUMENT_LATEST]->(d:Document) WHERE d.aiEnabled = true AND ( (ai.status = "in_progress" AND...
time2026-07-27 02:17:11 UTC
severityINFO
servicedocproc
clustermaster
podserver-2-dev-0
query
MATCH (ai:AIRun)-[:AI_RUN_TO_DOCUMENT_LATEST]->(d:Document)
WHERE d.aiEnabled = true
AND (
(ai.status = "in_progress" AND ($cutoff_ms <= 0 OR COALESCE(ai.updatedat, ai.createdat) < $cutoff_ms))
OR ai.status = "aborted"
)
RETURN count(ai) AS total
raw payload (15 fields)
{
"allocatedBytes": 488.0,
"cpu": 62.0,
"elapsedTimeMs": 63.0,
"executionPlanCacheKeyHash": "E4907905",
"id": "25355584",
"pageFaults": 0.0,
"pageHits": 66825.0,
"planning": 0.0,
"query": "\n MATCH (ai:AIRun)-[:AI_RUN_TO_DOCUMENT_LATEST]-\u003e(d:Document)\n WHERE d.aiEnabled = true\n AND (\n (ai.status = \"in_progress\" AND ($cutoff_ms \u003c= 0 OR COALESCE(ai.updatedat, ai.createdat) \u003c $cutoff_ms))\n OR ai.status = \"aborted\"\n )\n RETURN count(ai) AS total\n ",
"queryParameters": "{cutoff_ms: 0}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.2.71:49876\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:11.295Z",
"transactionId": 12246571.0,
"waiting": 0.0
}39s ago2026-07-27 02:17:10 UTC DEBUG docproc Pulling messages
time2026-07-27 02:17:10 UTC
severityDEBUG
servicedocproc
sourcehandlers/pubsub_handler.py:240
clustermaster
version0.1.0
poddocproc-7bc76669-ljh8h
message
Pulling messages
raw payload (11 fields)
{
"caller": "handlers/pubsub_handler.py:240",
"cluster": "master",
"component": "pubsub",
"environment": "DEVELOPMENT",
"max_messages": 1.0,
"message": "Pulling messages",
"pull_timeout_s": 60.0,
"service": "docproc",
"subscription_name": "tilda-document-master-docproc-sub",
"timestamp": "2026-07-27T02:17:10.988Z",
"version": "0.1.0"
}39s ago2026-07-27 02:17:10 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:10 UTC
severityINFO
clustermaster
podlitellm-f54655c99-tt2pg
39s ago2026-07-27 02:17:10 UTC INFO
filter by:
severity≥INFO
time2026-07-27 02:17:10 UTC
severityINFO
clustermaster
podrag-agent-57879dd94f-l9nz7
40s ago2026-07-27 02:17:09 UTC DEBUG docproc Pull returned 0 messages
time2026-07-27 02:17:09 UTC
severityDEBUG
servicedocproc
sourcehandlers/pubsub_handler.py:284
clustermaster
version0.1.0
poddocproc-7bc76669-ljh8h
message
Pull returned 0 messages
raw payload (9 fields)
{
"caller": "handlers/pubsub_handler.py:284",
"cluster": "master",
"component": "pubsub",
"environment": "DEVELOPMENT",
"message": "Pull returned 0 messages",
"service": "docproc",
"subscription_name": "tilda-document-master-docproc-sub",
"timestamp": "2026-07-27T02:17:09.985Z",
"version": "0.1.0"
}40s ago2026-07-27 02:17:09 UTC DEBUG docproc Recovery fill
time2026-07-27 02:17:09 UTC
severityDEBUG
servicedocproc
sourcehandlers/pubsub_handler.py:429
clustermaster
version0.1.0
poddocproc-7bc76669-ljh8h
message
Recovery fill
raw payload (13 fields)
{
"adopt_list_len": 0.0,
"adopt_started": 0.0,
"backlog_list_len": 0.0,
"backlog_started": 0.0,
"caller": "handlers/pubsub_handler.py:429",
"cluster": "master",
"component": "pubsub",
"environment": "DEVELOPMENT",
"message": "Recovery fill",
"remaining_slots": 10.0,
"service": "docproc",
"timestamp": "2026-07-27T02:17:09.985Z",
"version": "0.1.0"
}40s ago2026-07-27 02:17:09 UTC neo4j docproc MATCH (o:Organization{orgType:"CRO"})-[:DOC_TO_ORG]-(d:Document)-[:INCLUDES]-(f:Folder) WHERE f.name IN ['Staging', 'Pre-Staging'] ...
time2026-07-27 02:17:09 UTC
severityINFO
servicedocproc
clustermaster
podserver-2-dev-0
query
MATCH (o:Organization{orgType:"CRO"})-[:DOC_TO_ORG]-(d:Document)-[:INCLUDES]-(f:Folder)
WHERE f.name IN ['Staging', 'Pre-Staging']
AND d.delpending = false AND d.aiEnabled = true AND d.studyId <> ""
AND d.primaryVersionId IS NOT NULL AND d.primaryVersionId <> ""
OPTIONAL MATCH (d)<-[:AI_RUN_TO_DOCUMENT_LATEST]-(ai:AIRun)
WITH o, d, ai
ORDER BY d.tildaid, COALESCE(ai.updatedat, ai.createdat) DESC
WITH o, d, collect(ai)[0] AS latest_ai
WHERE (
latest_ai IS NULL
OR latest_ai.status = "aborted"
OR (
latest_ai.status = "failed"
AND COALESCE(latest_ai.auto_retry_count, 0) < $max_retries
AND COALESCE(latest_ai.updatedat, latest_ai.createdat) < $threshold_ms
)
)
WITH d.tildaid AS doc_id, o.alias AS org_alias, d.primaryVersionId AS version_id,
d.studyId AS study_id, COALESCE(latest_ai.auto_retry_count, 0) AS current_retry_count
RETURN doc_id, org_alias, version_id, study_id, current_retry_count
ORDER BY doc_id
LIMIT $limit
raw payload (15 fields)
{
"allocatedBytes": 9610664.0,
"cpu": 274.0,
"elapsedTimeMs": 274.0,
"executionPlanCacheKeyHash": "7644B06C",
"id": "25355318",
"pageFaults": 0.0,
"pageHits": 156448.0,
"planning": 0.0,
"query": "\n MATCH (o:Organization{orgType:\"CRO\"})-[:DOC_TO_ORG]-(d:Document)-[:INCLUDES]-(f:Folder)\n WHERE f.name IN [\u0027Staging\u0027, \u0027Pre-Staging\u0027]\n AND d.delpending = false AND d.aiEnabled = true AND d.studyId \u003c\u003e \"\"\n AND d.primaryVersionId IS NOT NULL AND d.primaryVersionId \u003c\u003e \"\"\n OPTIONAL MATCH (d)\u003c-[:AI_RUN_TO_DOCUMENT_LATEST]-(ai:AIRun)\n WITH o, d, ai\n ORDER BY d.tildaid, COALESCE(ai.updatedat, ai.createdat) DESC\n WITH o, d, collect(ai)[0] AS latest_ai\n WHERE (\n latest_ai IS NULL\n OR latest_ai.status = \"aborted\"\n OR (\n latest_ai.status = \"failed\"\n AND COALESCE(latest_ai.auto_retry_count, 0) \u003c $max_retries\n AND COALESCE(latest_ai.updatedat, latest_ai.createdat) \u003c $threshold_ms\n )\n )\n WITH d.tildaid AS doc_id, o.alias AS org_alias, d.primaryVersionId AS version_id,\n d.studyId AS study_id, COALESCE(latest_ai.auto_retry_count, 0) AS current_retry_count\n RETURN doc_id, org_alias, version_id, study_id, current_retry_count\n ORDER BY doc_id\n LIMIT $limit\n ",
"queryParameters": "{limit: 10, max_retries: 5, threshold_ms: 1785117729702}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-java/5.28.13-24cd0fecc64de123fd5711190246e8b0f1e16fd0\t\tclient/10.173.2.71:49876\tserver/10.173.0.8:7688\u003e",
"timestamp": "2026-07-27T02:17:09.981Z",
"transactionId": 12246538.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC INFO virtual-assistant 🏁 Daily check complete: orgs=6, work_orders=409, reminders_sent=0, moved_to_need_attention=0
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:393
clustermaster
versionunknown
podvirtual-assistant-65b975d66b-l8wpw
message
🏁 Daily check complete: orgs=6, work_orders=409, reminders_sent=0, moved_to_need_attention=0
raw payload (7 fields)
{
"caller": "jobs/daily_work_order_cron.py:393",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\ud83c\udfc1 Daily check complete: orgs=6, work_orders=409, reminders_sent=0, moved_to_need_attention=0",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.979Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC INFO virtual-assistant No work order locks currently held
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
sourceshared/work_order_locks.py:147
clustermaster
versionunknown
podvirtual-assistant-65b975d66b-l8wpw
message
No work order locks currently held
raw payload (7 fields)
{
"caller": "shared/work_order_locks.py:147",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "No work order locks currently held",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.979Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant 🔍 Final lock status after daily check:
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:385
clustermaster
versionunknown
podvirtual-assistant-65b975d66b-l8wpw
message
🔍 Final lock status after daily check:
raw payload (7 fields)
{
"caller": "jobs/daily_work_order_cron.py:385",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\ud83d\udd0d Final lock status after daily check:",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.978Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant ✅ Org 4510cbf5-af86-40c7-ba81-1e7aa0df8c2e summary: processed=4, reminders_sent=0, moved_to_need_attention=0
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:377
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
✅ Org 4510cbf5-af86-40c7-ba81-1e7aa0df8c2e summary: processed=4, reminders_sent=0, moved_to_need_attention=0
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:377",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\u2705 Org 4510cbf5-af86-40c7-ba81-1e7aa0df8c2e summary: processed=4, reminders_sent=0, moved_to_need_attention=0",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.978Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [reminder] wo=5fda6743-4617-464f-9598-5ffebf341fa6 mode=RECURRING should_send=False escalate=False override=none reason='RECURRING not due:...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:244
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
[reminder] wo=5fda6743-4617-464f-9598-5ffebf341fa6 mode=RECURRING should_send=False escalate=False override=none reason='RECURRING not due: now-base=957m < step=1440m'
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:244",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[reminder] wo=5fda6743-4617-464f-9598-5ffebf341fa6 mode=RECURRING should_send=False escalate=False override=none reason=\u0027RECURRING not due: now-base=957m \u003c step=1440m\u0027",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.978Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})<-[:FACT_TO_WORK_ORDER]-(f:Fact) WHERE f.delpending = false ...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})<-[:FACT_TO_WORK_ORDER]-(f:Fact)
WHERE f.delpending = false
RETURN f
ORDER BY f.createdat ASC
raw payload (15 fields)
{
"allocatedBytes": 724.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "23A43F51",
"id": "25355386",
"pageFaults": 0.0,
"pageHits": 6.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})\u003c-[:FACT_TO_WORK_ORDER]-(f:Fact)\n WHERE f.delpending = false\n RETURN f\n ORDER BY f.createdat ASC\n ",
"queryParameters": "{work_order_id: \u00275fda6743-4617-464f-9598-5ffebf341fa6\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.975Z",
"transactionId": 12246569.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity) WHERE 1=1 AND a.activity_type IN...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity)
WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses
OPTIONAL MATCH (d:Document)
WHERE d.tildaid IN COALESCE(a.docIds, [])
WITH w, a, COLLECT(DISTINCT {tildaid: d.tildaid, fileName: d.fileName, contentType: d.contentType}) as documents
// Compute latest AI_MSG draft id per work order for gating REGENERATE
OPTIONAL MATCH (w)-[:WORK_ORDER_TO_ACTIVITY]->(ai:WorkOrderActivity)
WHERE ai.activity_type = 'AI_MSG' // any status: a newer SENT/QUEUED must supersede an older FindingsChanged draft, else REGENERATE stays stuck
WITH w, a, documents,
max(coalesce(ai.updatedat, ai.createdat)) AS latest_any_ts,
collect({id: ai.tildaid, ts: coalesce(ai.updatedat, ai.createdat), status: ai.status, ignoreType: ai.ignoreType}) AS ai_msgs
WITH a, documents,
CASE
WHEN size(ai_msgs) = 0 THEN false
ELSE any(x IN ai_msgs WHERE x.id = a.tildaid AND x.ts = latest_any_ts)
END AS is_latest_draft
RETURN a,
CASE WHEN size(documents) > 0 AND documents[0].tildaid IS NOT NULL THEN documents ELSE [] END AS documents,
is_latest_draft
ORDER BY a.createdat DESC
SKIP $skip
LIMIT $limit
raw payload (15 fields)
{
"allocatedBytes": 3272.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "2A13D7A9",
"id": "25355385",
"pageFaults": 0.0,
"pageHits": 12.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]-\u003e(a:WorkOrderActivity)\n WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses \n OPTIONAL MATCH (d:Document)\n WHERE d.tildaid IN COALESCE(a.docIds, [])\n WITH w, a, COLLECT(DISTINCT {tildaid: d.tildaid, fileName: d.fileName, contentType: d.contentType}) as documents\n // Compute latest AI_MSG draft id per work order for gating REGENERATE\n OPTIONAL MATCH (w)-[:WORK_ORDER_TO_ACTIVITY]-\u003e(ai:WorkOrderActivity)\n WHERE ai.activity_type = \u0027AI_MSG\u0027 // any status: a newer SENT/QUEUED must supersede an older FindingsChanged draft, else REGENERATE stays stuck\n WITH w, a, documents,\n max(coalesce(ai.updatedat, ai.createdat)) AS latest_any_ts,\n collect({id: ai.tildaid, ts: coalesce(ai.updatedat, ai.createdat), status: ai.status, ignoreType: ai.ignoreType}) AS ai_msgs\n WITH a, documents,\n CASE\n WHEN size(ai_msgs) = 0 THEN false\n ELSE any(x IN ai_msgs WHERE x.id = a.tildaid AND x.ts = latest_any_ts)\n END AS is_latest_draft\n RETURN a,\n CASE WHEN size(documents) \u003e 0 AND documents[0].tildaid IS NOT NULL THEN documents ELSE [] END AS documents,\n is_latest_draft\n ORDER BY a.createdat DESC\n SKIP $skip\n LIMIT $limit\n ",
"queryParameters": "{limit: 1, statuses: [\u0027DRAFT\u0027], skip: 0, work_order_id: \u00275fda6743-4617-464f-9598-5ffebf341fa6\u0027, activity_types: [\u0027AI_MSG\u0027]}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.968Z",
"transactionId": 12246568.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity) WHERE 1=1 AND a.activity_type IN...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity)
WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses
RETURN count(a) as total
raw payload (15 fields)
{
"allocatedBytes": 488.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "FA66F084",
"id": "25355384",
"pageFaults": 0.0,
"pageHits": 13.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]-\u003e(a:WorkOrderActivity)\n WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses \n RETURN count(a) as total\n ",
"queryParameters": "{statuses: [\u0027DRAFT\u0027], work_order_id: \u00275fda6743-4617-464f-9598-5ffebf341fa6\u0027, activity_types: [\u0027AI_MSG\u0027]}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.965Z",
"transactionId": 12246568.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (wo:WorkOrder {tildaid: $wo_id}) OPTIONAL MATCH (wo)-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity {activity_type:...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (wo:WorkOrder {tildaid: $wo_id})
OPTIONAL MATCH (wo)-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity {activity_type: 'U_REPLY'})
RETURN wo.createdat AS created_at, max(a.timestamp) AS latest_reply_ts
raw payload (15 fields)
{
"allocatedBytes": 928.0,
"cpu": 0.0,
"elapsedTimeMs": 1.0,
"executionPlanCacheKeyHash": "4C51129A",
"id": "25355381",
"pageFaults": 0.0,
"pageHits": 15.0,
"planning": 0.0,
"query": "\n MATCH (wo:WorkOrder {tildaid: $wo_id})\n OPTIONAL MATCH (wo)-[:WORK_ORDER_TO_ACTIVITY]-\u003e(a:WorkOrderActivity {activity_type: \u0027U_REPLY\u0027})\n RETURN wo.createdat AS created_at, max(a.timestamp) AS latest_reply_ts\n ",
"queryParameters": "{wo_id: \u00275fda6743-4617-464f-9598-5ffebf341fa6\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.958Z",
"transactionId": 12246567.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (n:WorkOrder {tildaid: $node_id}) RETURN n
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (n:WorkOrder {tildaid: $node_id})
RETURN n
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "E0146DD7",
"id": "25355380",
"pageFaults": 0.0,
"pageHits": 8.0,
"planning": 0.0,
"query": "MATCH (n:WorkOrder {tildaid: $node_id}) RETURN n",
"queryParameters": "{node_id: \u00275fda6743-4617-464f-9598-5ffebf341fa6\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.950Z",
"transactionId": 12246566.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [daily_cron] Starting processing for work order 5fda6743-4617-464f-9598-5ffebf341fa6
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:135
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
[daily_cron] Starting processing for work order 5fda6743-4617-464f-9598-5ffebf341fa6
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:135",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[daily_cron] Starting processing for work order 5fda6743-4617-464f-9598-5ffebf341fa6",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.945Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [daily_cron] About to process work order 5fda6743-4617-464f-9598-5ffebf341fa6
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:368
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
[daily_cron] About to process work order 5fda6743-4617-464f-9598-5ffebf341fa6
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:368",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[daily_cron] About to process work order 5fda6743-4617-464f-9598-5ffebf341fa6",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.945Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [reminder] wo=322547e7-b0fd-4d98-963d-afb231950377 no reminder policy (NONE) — nothing to do
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:220
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
[reminder] wo=322547e7-b0fd-4d98-963d-afb231950377 no reminder policy (NONE) — nothing to do
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:220",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[reminder] wo=322547e7-b0fd-4d98-963d-afb231950377 no reminder policy (NONE) \u2014 nothing to do",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.945Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})<-[:FACT_TO_WORK_ORDER]-(f:Fact) WHERE f.delpending = false ...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})<-[:FACT_TO_WORK_ORDER]-(f:Fact)
WHERE f.delpending = false
RETURN f
ORDER BY f.createdat ASC
raw payload (15 fields)
{
"allocatedBytes": 724.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "23A43F51",
"id": "25355378",
"pageFaults": 0.0,
"pageHits": 7.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})\u003c-[:FACT_TO_WORK_ORDER]-(f:Fact)\n WHERE f.delpending = false\n RETURN f\n ORDER BY f.createdat ASC\n ",
"queryParameters": "{work_order_id: \u0027322547e7-b0fd-4d98-963d-afb231950377\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.942Z",
"transactionId": 12246565.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity) WHERE 1=1 AND a.activity_type IN...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity)
WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses
OPTIONAL MATCH (d:Document)
WHERE d.tildaid IN COALESCE(a.docIds, [])
WITH w, a, COLLECT(DISTINCT {tildaid: d.tildaid, fileName: d.fileName, contentType: d.contentType}) as documents
// Compute latest AI_MSG draft id per work order for gating REGENERATE
OPTIONAL MATCH (w)-[:WORK_ORDER_TO_ACTIVITY]->(ai:WorkOrderActivity)
WHERE ai.activity_type = 'AI_MSG' // any status: a newer SENT/QUEUED must supersede an older FindingsChanged draft, else REGENERATE stays stuck
WITH w, a, documents,
max(coalesce(ai.updatedat, ai.createdat)) AS latest_any_ts,
collect({id: ai.tildaid, ts: coalesce(ai.updatedat, ai.createdat), status: ai.status, ignoreType: ai.ignoreType}) AS ai_msgs
WITH a, documents,
CASE
WHEN size(ai_msgs) = 0 THEN false
ELSE any(x IN ai_msgs WHERE x.id = a.tildaid AND x.ts = latest_any_ts)
END AS is_latest_draft
RETURN a,
CASE WHEN size(documents) > 0 AND documents[0].tildaid IS NOT NULL THEN documents ELSE [] END AS documents,
is_latest_draft
ORDER BY a.createdat DESC
SKIP $skip
LIMIT $limit
raw payload (15 fields)
{
"allocatedBytes": 3272.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "2A13D7A9",
"id": "25355376",
"pageFaults": 0.0,
"pageHits": 8.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]-\u003e(a:WorkOrderActivity)\n WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses \n OPTIONAL MATCH (d:Document)\n WHERE d.tildaid IN COALESCE(a.docIds, [])\n WITH w, a, COLLECT(DISTINCT {tildaid: d.tildaid, fileName: d.fileName, contentType: d.contentType}) as documents\n // Compute latest AI_MSG draft id per work order for gating REGENERATE\n OPTIONAL MATCH (w)-[:WORK_ORDER_TO_ACTIVITY]-\u003e(ai:WorkOrderActivity)\n WHERE ai.activity_type = \u0027AI_MSG\u0027 // any status: a newer SENT/QUEUED must supersede an older FindingsChanged draft, else REGENERATE stays stuck\n WITH w, a, documents,\n max(coalesce(ai.updatedat, ai.createdat)) AS latest_any_ts,\n collect({id: ai.tildaid, ts: coalesce(ai.updatedat, ai.createdat), status: ai.status, ignoreType: ai.ignoreType}) AS ai_msgs\n WITH a, documents,\n CASE\n WHEN size(ai_msgs) = 0 THEN false\n ELSE any(x IN ai_msgs WHERE x.id = a.tildaid AND x.ts = latest_any_ts)\n END AS is_latest_draft\n RETURN a,\n CASE WHEN size(documents) \u003e 0 AND documents[0].tildaid IS NOT NULL THEN documents ELSE [] END AS documents,\n is_latest_draft\n ORDER BY a.createdat DESC\n SKIP $skip\n LIMIT $limit\n ",
"queryParameters": "{limit: 1, statuses: [\u0027DRAFT\u0027], skip: 0, work_order_id: \u0027322547e7-b0fd-4d98-963d-afb231950377\u0027, activity_types: [\u0027AI_MSG\u0027]}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.935Z",
"transactionId": 12246564.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity) WHERE 1=1 AND a.activity_type IN...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity)
WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses
RETURN count(a) as total
raw payload (15 fields)
{
"allocatedBytes": 488.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "FA66F084",
"id": "25355375",
"pageFaults": 0.0,
"pageHits": 9.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]-\u003e(a:WorkOrderActivity)\n WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses \n RETURN count(a) as total\n ",
"queryParameters": "{statuses: [\u0027DRAFT\u0027], work_order_id: \u0027322547e7-b0fd-4d98-963d-afb231950377\u0027, activity_types: [\u0027AI_MSG\u0027]}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.932Z",
"transactionId": 12246564.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (wo:WorkOrder {tildaid: $wo_id}) OPTIONAL MATCH (wo)-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity {activity_type:...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (wo:WorkOrder {tildaid: $wo_id})
OPTIONAL MATCH (wo)-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity {activity_type: 'U_REPLY'})
RETURN wo.createdat AS created_at, max(a.timestamp) AS latest_reply_ts
raw payload (15 fields)
{
"allocatedBytes": 928.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "4C51129A",
"id": "25355373",
"pageFaults": 0.0,
"pageHits": 13.0,
"planning": 0.0,
"query": "\n MATCH (wo:WorkOrder {tildaid: $wo_id})\n OPTIONAL MATCH (wo)-[:WORK_ORDER_TO_ACTIVITY]-\u003e(a:WorkOrderActivity {activity_type: \u0027U_REPLY\u0027})\n RETURN wo.createdat AS created_at, max(a.timestamp) AS latest_reply_ts\n ",
"queryParameters": "{wo_id: \u0027322547e7-b0fd-4d98-963d-afb231950377\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.925Z",
"transactionId": 12246563.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (n:WorkOrder {tildaid: $node_id}) RETURN n
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (n:WorkOrder {tildaid: $node_id})
RETURN n
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "E0146DD7",
"id": "25355371",
"pageFaults": 0.0,
"pageHits": 7.0,
"planning": 0.0,
"query": "MATCH (n:WorkOrder {tildaid: $node_id}) RETURN n",
"queryParameters": "{node_id: \u0027322547e7-b0fd-4d98-963d-afb231950377\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.917Z",
"transactionId": 12246562.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [daily_cron] Starting processing for work order 322547e7-b0fd-4d98-963d-afb231950377
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:135
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
[daily_cron] Starting processing for work order 322547e7-b0fd-4d98-963d-afb231950377
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:135",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[daily_cron] Starting processing for work order 322547e7-b0fd-4d98-963d-afb231950377",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.913Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [daily_cron] About to process work order 322547e7-b0fd-4d98-963d-afb231950377
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:368
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
[daily_cron] About to process work order 322547e7-b0fd-4d98-963d-afb231950377
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:368",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[daily_cron] About to process work order 322547e7-b0fd-4d98-963d-afb231950377",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.912Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [reminder] wo=6ff3918b-05db-4310-bde3-9019341f582a no reminder policy (NONE) — nothing to do
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:220
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
[reminder] wo=6ff3918b-05db-4310-bde3-9019341f582a no reminder policy (NONE) — nothing to do
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:220",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[reminder] wo=6ff3918b-05db-4310-bde3-9019341f582a no reminder policy (NONE) \u2014 nothing to do",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.912Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})<-[:FACT_TO_WORK_ORDER]-(f:Fact) WHERE f.delpending = false ...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})<-[:FACT_TO_WORK_ORDER]-(f:Fact)
WHERE f.delpending = false
RETURN f
ORDER BY f.createdat ASC
raw payload (15 fields)
{
"allocatedBytes": 724.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "23A43F51",
"id": "25355369",
"pageFaults": 0.0,
"pageHits": 7.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})\u003c-[:FACT_TO_WORK_ORDER]-(f:Fact)\n WHERE f.delpending = false\n RETURN f\n ORDER BY f.createdat ASC\n ",
"queryParameters": "{work_order_id: \u00276ff3918b-05db-4310-bde3-9019341f582a\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.909Z",
"transactionId": 12246561.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity) WHERE 1=1 AND a.activity_type IN...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity)
WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses
OPTIONAL MATCH (d:Document)
WHERE d.tildaid IN COALESCE(a.docIds, [])
WITH w, a, COLLECT(DISTINCT {tildaid: d.tildaid, fileName: d.fileName, contentType: d.contentType}) as documents
// Compute latest AI_MSG draft id per work order for gating REGENERATE
OPTIONAL MATCH (w)-[:WORK_ORDER_TO_ACTIVITY]->(ai:WorkOrderActivity)
WHERE ai.activity_type = 'AI_MSG' // any status: a newer SENT/QUEUED must supersede an older FindingsChanged draft, else REGENERATE stays stuck
WITH w, a, documents,
max(coalesce(ai.updatedat, ai.createdat)) AS latest_any_ts,
collect({id: ai.tildaid, ts: coalesce(ai.updatedat, ai.createdat), status: ai.status, ignoreType: ai.ignoreType}) AS ai_msgs
WITH a, documents,
CASE
WHEN size(ai_msgs) = 0 THEN false
ELSE any(x IN ai_msgs WHERE x.id = a.tildaid AND x.ts = latest_any_ts)
END AS is_latest_draft
RETURN a,
CASE WHEN size(documents) > 0 AND documents[0].tildaid IS NOT NULL THEN documents ELSE [] END AS documents,
is_latest_draft
ORDER BY a.createdat DESC
SKIP $skip
LIMIT $limit
raw payload (15 fields)
{
"allocatedBytes": 3272.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "2A13D7A9",
"id": "25355368",
"pageFaults": 0.0,
"pageHits": 11.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]-\u003e(a:WorkOrderActivity)\n WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses \n OPTIONAL MATCH (d:Document)\n WHERE d.tildaid IN COALESCE(a.docIds, [])\n WITH w, a, COLLECT(DISTINCT {tildaid: d.tildaid, fileName: d.fileName, contentType: d.contentType}) as documents\n // Compute latest AI_MSG draft id per work order for gating REGENERATE\n OPTIONAL MATCH (w)-[:WORK_ORDER_TO_ACTIVITY]-\u003e(ai:WorkOrderActivity)\n WHERE ai.activity_type = \u0027AI_MSG\u0027 // any status: a newer SENT/QUEUED must supersede an older FindingsChanged draft, else REGENERATE stays stuck\n WITH w, a, documents,\n max(coalesce(ai.updatedat, ai.createdat)) AS latest_any_ts,\n collect({id: ai.tildaid, ts: coalesce(ai.updatedat, ai.createdat), status: ai.status, ignoreType: ai.ignoreType}) AS ai_msgs\n WITH a, documents,\n CASE\n WHEN size(ai_msgs) = 0 THEN false\n ELSE any(x IN ai_msgs WHERE x.id = a.tildaid AND x.ts = latest_any_ts)\n END AS is_latest_draft\n RETURN a,\n CASE WHEN size(documents) \u003e 0 AND documents[0].tildaid IS NOT NULL THEN documents ELSE [] END AS documents,\n is_latest_draft\n ORDER BY a.createdat DESC\n SKIP $skip\n LIMIT $limit\n ",
"queryParameters": "{limit: 1, statuses: [\u0027DRAFT\u0027], skip: 0, work_order_id: \u00276ff3918b-05db-4310-bde3-9019341f582a\u0027, activity_types: [\u0027AI_MSG\u0027]}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.902Z",
"transactionId": 12246560.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity) WHERE 1=1 AND a.activity_type IN...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity)
WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses
RETURN count(a) as total
raw payload (15 fields)
{
"allocatedBytes": 488.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "FA66F084",
"id": "25355367",
"pageFaults": 0.0,
"pageHits": 12.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]-\u003e(a:WorkOrderActivity)\n WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses \n RETURN count(a) as total\n ",
"queryParameters": "{statuses: [\u0027DRAFT\u0027], work_order_id: \u00276ff3918b-05db-4310-bde3-9019341f582a\u0027, activity_types: [\u0027AI_MSG\u0027]}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.899Z",
"transactionId": 12246560.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (wo:WorkOrder {tildaid: $wo_id}) OPTIONAL MATCH (wo)-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity {activity_type:...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (wo:WorkOrder {tildaid: $wo_id})
OPTIONAL MATCH (wo)-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity {activity_type: 'U_REPLY'})
RETURN wo.createdat AS created_at, max(a.timestamp) AS latest_reply_ts
raw payload (15 fields)
{
"allocatedBytes": 928.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "4C51129A",
"id": "25355365",
"pageFaults": 0.0,
"pageHits": 16.0,
"planning": 0.0,
"query": "\n MATCH (wo:WorkOrder {tildaid: $wo_id})\n OPTIONAL MATCH (wo)-[:WORK_ORDER_TO_ACTIVITY]-\u003e(a:WorkOrderActivity {activity_type: \u0027U_REPLY\u0027})\n RETURN wo.createdat AS created_at, max(a.timestamp) AS latest_reply_ts\n ",
"queryParameters": "{wo_id: \u00276ff3918b-05db-4310-bde3-9019341f582a\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.892Z",
"transactionId": 12246559.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (n:WorkOrder {tildaid: $node_id}) RETURN n
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (n:WorkOrder {tildaid: $node_id})
RETURN n
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "E0146DD7",
"id": "25355364",
"pageFaults": 0.0,
"pageHits": 8.0,
"planning": 0.0,
"query": "MATCH (n:WorkOrder {tildaid: $node_id}) RETURN n",
"queryParameters": "{node_id: \u00276ff3918b-05db-4310-bde3-9019341f582a\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.884Z",
"transactionId": 12246558.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [daily_cron] Starting processing for work order 6ff3918b-05db-4310-bde3-9019341f582a
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:135
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
[daily_cron] Starting processing for work order 6ff3918b-05db-4310-bde3-9019341f582a
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:135",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[daily_cron] Starting processing for work order 6ff3918b-05db-4310-bde3-9019341f582a",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.879Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [daily_cron] About to process work order 6ff3918b-05db-4310-bde3-9019341f582a
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:368
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
[daily_cron] About to process work order 6ff3918b-05db-4310-bde3-9019341f582a
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:368",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[daily_cron] About to process work order 6ff3918b-05db-4310-bde3-9019341f582a",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.879Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [reminder] wo=c10303ac-4c50-40fa-9713-4e535108f3b7 no reminder policy (NONE) — nothing to do
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:220
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
[reminder] wo=c10303ac-4c50-40fa-9713-4e535108f3b7 no reminder policy (NONE) — nothing to do
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:220",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[reminder] wo=c10303ac-4c50-40fa-9713-4e535108f3b7 no reminder policy (NONE) \u2014 nothing to do",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.879Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})<-[:FACT_TO_WORK_ORDER]-(f:Fact) WHERE f.delpending = false ...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})<-[:FACT_TO_WORK_ORDER]-(f:Fact)
WHERE f.delpending = false
RETURN f
ORDER BY f.createdat ASC
raw payload (15 fields)
{
"allocatedBytes": 724.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "23A43F51",
"id": "25355361",
"pageFaults": 0.0,
"pageHits": 6.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})\u003c-[:FACT_TO_WORK_ORDER]-(f:Fact)\n WHERE f.delpending = false\n RETURN f\n ORDER BY f.createdat ASC\n ",
"queryParameters": "{work_order_id: \u0027c10303ac-4c50-40fa-9713-4e535108f3b7\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.876Z",
"transactionId": 12246557.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity) WHERE 1=1 AND a.activity_type IN...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity)
WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses
OPTIONAL MATCH (d:Document)
WHERE d.tildaid IN COALESCE(a.docIds, [])
WITH w, a, COLLECT(DISTINCT {tildaid: d.tildaid, fileName: d.fileName, contentType: d.contentType}) as documents
// Compute latest AI_MSG draft id per work order for gating REGENERATE
OPTIONAL MATCH (w)-[:WORK_ORDER_TO_ACTIVITY]->(ai:WorkOrderActivity)
WHERE ai.activity_type = 'AI_MSG' // any status: a newer SENT/QUEUED must supersede an older FindingsChanged draft, else REGENERATE stays stuck
WITH w, a, documents,
max(coalesce(ai.updatedat, ai.createdat)) AS latest_any_ts,
collect({id: ai.tildaid, ts: coalesce(ai.updatedat, ai.createdat), status: ai.status, ignoreType: ai.ignoreType}) AS ai_msgs
WITH a, documents,
CASE
WHEN size(ai_msgs) = 0 THEN false
ELSE any(x IN ai_msgs WHERE x.id = a.tildaid AND x.ts = latest_any_ts)
END AS is_latest_draft
RETURN a,
CASE WHEN size(documents) > 0 AND documents[0].tildaid IS NOT NULL THEN documents ELSE [] END AS documents,
is_latest_draft
ORDER BY a.createdat DESC
SKIP $skip
LIMIT $limit
raw payload (15 fields)
{
"allocatedBytes": 3272.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "2A13D7A9",
"id": "25355359",
"pageFaults": 0.0,
"pageHits": 17.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]-\u003e(a:WorkOrderActivity)\n WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses \n OPTIONAL MATCH (d:Document)\n WHERE d.tildaid IN COALESCE(a.docIds, [])\n WITH w, a, COLLECT(DISTINCT {tildaid: d.tildaid, fileName: d.fileName, contentType: d.contentType}) as documents\n // Compute latest AI_MSG draft id per work order for gating REGENERATE\n OPTIONAL MATCH (w)-[:WORK_ORDER_TO_ACTIVITY]-\u003e(ai:WorkOrderActivity)\n WHERE ai.activity_type = \u0027AI_MSG\u0027 // any status: a newer SENT/QUEUED must supersede an older FindingsChanged draft, else REGENERATE stays stuck\n WITH w, a, documents,\n max(coalesce(ai.updatedat, ai.createdat)) AS latest_any_ts,\n collect({id: ai.tildaid, ts: coalesce(ai.updatedat, ai.createdat), status: ai.status, ignoreType: ai.ignoreType}) AS ai_msgs\n WITH a, documents,\n CASE\n WHEN size(ai_msgs) = 0 THEN false\n ELSE any(x IN ai_msgs WHERE x.id = a.tildaid AND x.ts = latest_any_ts)\n END AS is_latest_draft\n RETURN a,\n CASE WHEN size(documents) \u003e 0 AND documents[0].tildaid IS NOT NULL THEN documents ELSE [] END AS documents,\n is_latest_draft\n ORDER BY a.createdat DESC\n SKIP $skip\n LIMIT $limit\n ",
"queryParameters": "{limit: 1, statuses: [\u0027DRAFT\u0027], skip: 0, work_order_id: \u0027c10303ac-4c50-40fa-9713-4e535108f3b7\u0027, activity_types: [\u0027AI_MSG\u0027]}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.869Z",
"transactionId": 12246556.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity) WHERE 1=1 AND a.activity_type IN...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity)
WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses
RETURN count(a) as total
raw payload (15 fields)
{
"allocatedBytes": 488.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "FA66F084",
"id": "25355357",
"pageFaults": 0.0,
"pageHits": 18.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})-[:WORK_ORDER_TO_ACTIVITY]-\u003e(a:WorkOrderActivity)\n WHERE 1=1 AND a.activity_type IN $activity_types AND a.status IN $statuses \n RETURN count(a) as total\n ",
"queryParameters": "{statuses: [\u0027DRAFT\u0027], work_order_id: \u0027c10303ac-4c50-40fa-9713-4e535108f3b7\u0027, activity_types: [\u0027AI_MSG\u0027]}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.866Z",
"transactionId": 12246556.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (wo:WorkOrder {tildaid: $wo_id}) OPTIONAL MATCH (wo)-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity {activity_type:...
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (wo:WorkOrder {tildaid: $wo_id})
OPTIONAL MATCH (wo)-[:WORK_ORDER_TO_ACTIVITY]->(a:WorkOrderActivity {activity_type: 'U_REPLY'})
RETURN wo.createdat AS created_at, max(a.timestamp) AS latest_reply_ts
raw payload (15 fields)
{
"allocatedBytes": 928.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "4C51129A",
"id": "25355356",
"pageFaults": 0.0,
"pageHits": 26.0,
"planning": 0.0,
"query": "\n MATCH (wo:WorkOrder {tildaid: $wo_id})\n OPTIONAL MATCH (wo)-[:WORK_ORDER_TO_ACTIVITY]-\u003e(a:WorkOrderActivity {activity_type: \u0027U_REPLY\u0027})\n RETURN wo.createdat AS created_at, max(a.timestamp) AS latest_reply_ts\n ",
"queryParameters": "{wo_id: \u0027c10303ac-4c50-40fa-9713-4e535108f3b7\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.859Z",
"transactionId": 12246555.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (n:WorkOrder {tildaid: $node_id}) RETURN n
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥INFO
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podserver-2-dev-0
query
MATCH (n:WorkOrder {tildaid: $node_id})
RETURN n
raw payload (15 fields)
{
"allocatedBytes": 312.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "E0146DD7",
"id": "25355355",
"pageFaults": 0.0,
"pageHits": 7.0,
"planning": 0.0,
"query": "MATCH (n:WorkOrder {tildaid: $node_id}) RETURN n",
"queryParameters": "{node_id: \u0027c10303ac-4c50-40fa-9713-4e535108f3b7\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.852Z",
"transactionId": 12246554.0,
"waiting": 0.0
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [daily_cron] Starting processing for work order c10303ac-4c50-40fa-9713-4e535108f3b7
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:135
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
[daily_cron] Starting processing for work order c10303ac-4c50-40fa-9713-4e535108f3b7
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:135",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[daily_cron] Starting processing for work order c10303ac-4c50-40fa-9713-4e535108f3b7",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.847Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [daily_cron] About to process work order c10303ac-4c50-40fa-9713-4e535108f3b7
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:368
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
[daily_cron] About to process work order c10303ac-4c50-40fa-9713-4e535108f3b7
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:368",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[daily_cron] About to process work order c10303ac-4c50-40fa-9713-4e535108f3b7",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.847Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant 🏢 Processing organization 4510cbf5-af86-40c7-ba81-1e7aa0df8c2e (4 work orders)
filter by:
service=virtual-assistant
org=4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
severity≥DEBUG
trace=bf898753adf1c337…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:362
clustermaster
org4510cbf5-af86-40c7-ba81-1e7aa0df8c2e
versionunknown
tracebf898753adf1c3379ea755e742bf0919
span713fbb67e12e64b4
podvirtual-assistant-65b975d66b-l8wpw
message
🏢 Processing organization 4510cbf5-af86-40c7-ba81-1e7aa0df8c2e (4 work orders)
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:362",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\ud83c\udfe2 Processing organization 4510cbf5-af86-40c7-ba81-1e7aa0df8c2e (4 work orders)",
"org_alias": "4510cbf5-af86-40c7-ba81-1e7aa0df8c2e",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.847Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant ✅ Org 8a8c3a76-7bd6-45d4-9ca3-c9330f4aba30 summary: processed=2, reminders_sent=0, moved_to_need_attention=0
filter by:
service=virtual-assistant
org=8a8c3a76-7bd6-45d4-9ca3-c9330f4aba30
severity≥DEBUG
trace=6450e5e1df50f801…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:377
clustermaster
org8a8c3a76-7bd6-45d4-9ca3-c9330f4aba30
versionunknown
trace6450e5e1df50f801eff8a4204c804fc2
span66367daf97a4feeb
podvirtual-assistant-65b975d66b-l8wpw
message
✅ Org 8a8c3a76-7bd6-45d4-9ca3-c9330f4aba30 summary: processed=2, reminders_sent=0, moved_to_need_attention=0
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:377",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "\u2705 Org 8a8c3a76-7bd6-45d4-9ca3-c9330f4aba30 summary: processed=2, reminders_sent=0, moved_to_need_attention=0",
"org_alias": "8a8c3a76-7bd6-45d4-9ca3-c9330f4aba30",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.846Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC DEBUG virtual-assistant [reminder] wo=57c957cb-a23f-4f3a-8bf1-bb9e566a2b6e no reminder policy (NONE) — nothing to do
filter by:
service=virtual-assistant
org=8a8c3a76-7bd6-45d4-9ca3-c9330f4aba30
severity≥DEBUG
trace=6450e5e1df50f801…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityDEBUG
servicevirtual-assistant
sourcejobs/daily_work_order_cron.py:220
clustermaster
org8a8c3a76-7bd6-45d4-9ca3-c9330f4aba30
versionunknown
trace6450e5e1df50f801eff8a4204c804fc2
span66367daf97a4feeb
podvirtual-assistant-65b975d66b-l8wpw
message
[reminder] wo=57c957cb-a23f-4f3a-8bf1-bb9e566a2b6e no reminder policy (NONE) — nothing to do
raw payload (8 fields)
{
"caller": "jobs/daily_work_order_cron.py:220",
"cluster": "master",
"environment": "DEVELOPMENT",
"message": "[reminder] wo=57c957cb-a23f-4f3a-8bf1-bb9e566a2b6e no reminder policy (NONE) \u2014 nothing to do",
"org_alias": "8a8c3a76-7bd6-45d4-9ca3-c9330f4aba30",
"service": "virtual-assistant",
"timestamp": "2026-07-27T02:17:09.846Z",
"version": "unknown"
}40s ago2026-07-27 02:17:09 UTC neo4j virtual-assistant MATCH (w:WorkOrder {tildaid: $work_order_id})<-[:FACT_TO_WORK_ORDER]-(f:Fact) WHERE f.delpending = false ...
filter by:
service=virtual-assistant
org=8a8c3a76-7bd6-45d4-9ca3-c9330f4aba30
severity≥INFO
trace=6450e5e1df50f801…
open trace flow ›
time2026-07-27 02:17:09 UTC
severityINFO
servicevirtual-assistant
clustermaster
org8a8c3a76-7bd6-45d4-9ca3-c9330f4aba30
trace6450e5e1df50f801eff8a4204c804fc2
span66367daf97a4feeb
podserver-2-dev-0
query
MATCH (w:WorkOrder {tildaid: $work_order_id})<-[:FACT_TO_WORK_ORDER]-(f:Fact)
WHERE f.delpending = false
RETURN f
ORDER BY f.createdat ASC
raw payload (15 fields)
{
"allocatedBytes": 724.0,
"cpu": 0.0,
"elapsedTimeMs": 0.0,
"executionPlanCacheKeyHash": "23A43F51",
"id": "25355353",
"pageFaults": 0.0,
"pageHits": 5.0,
"planning": 0.0,
"query": "\n MATCH (w:WorkOrder {tildaid: $work_order_id})\u003c-[:FACT_TO_WORK_ORDER]-(f:Fact)\n WHERE f.delpending = false\n RETURN f\n ORDER BY f.createdat ASC\n ",
"queryParameters": "{work_order_id: \u002757c957cb-a23f-4f3a-8bf1-bb9e566a2b6e\u0027}",
"runtime": "pipelined",
"source": "bolt-session\tbolt\tneo4j-python/5.28.0 Python/3.12.13-final-0 (linux)\t\tclient/10.129.4.156:51512\tserver/10.173.0.8:7687\u003e",
"timestamp": "2026-07-27T02:17:09.843Z",
"transactionId": 12246553.0,
"waiting": 0.0
}Paginated with Cloud Logging page cursors, so you can walk the whole 6h window — not just the newest page. Click any filter by value to scope the view (resets to page 1). Paste a trace id to see every log line across all services for that one request.