[Epic] Most Expensive Queries

[spikecurtis]

This is an epic to track our most expensive SQL Queries as measured in our dogfood system and work to improve, either by making them faster or less frequent.

It also tracks general improvements that will help us track, diagnose, and remediate future expensive queries.

• bug: GetRunningPrebuiltWorkspaces creates lots of DB load #715
• bug: GetLatestWorkspaceBuildsByWorkspaceIDs creates a lot of DB load #716
• bug: GetLatestWorkspaceBuilds creates lots of DB load #717
• bug: GetTailnetTunnelPeerBindings creates lots of DB load #718
• bug: GetTemplateAverageBuildTime creates lots of DB load #719
• bug: GetProvisionerJobsByIDsWithQueuePosition creates lots of DB load #720
• bug: UpsertTemplateUsageStats creates lots of DB load #721
• bug: GetQuotaConsumedForUser creates lots of DB load #722
• Audit log slows to a crawl when nearing 1 million entries coder#17689
• bug: GetProvisionerDaemonsWithStatusByOrganization is slow and creates lots of DB load #724
• bug: GetWorkspaceByID is called millions of times per day on dogfood #725
• bug: GetUserByID is called millions of times per day on dogfood #726
• bug: GetWorkspaceAgentsInLatestBuildByWorkspaceID or GetWorkspaceAgentsByWorkspaceAndBuildNumber is called millions of times per day #727
• bug: GetWorkspaceByAgentID is called over a million times a day on dogfood #728
• Set up tracing on dogfood #730