refactor(server): migrate build_runs to Clickhouse (tuist#9355)

Author: Christoph Schmatzler

.github/workflows/server.yml

@@ -247,7 +247,7 @@ jobs:
     if: github.event.pull_request.draft == false || github.event_name != 'pull_request'
     services:
       postgres:
-        image: timescale/timescaledb-ha:pg16
+        image: postgres:16
         env:
           POSTGRES_USER: postgres
           POSTGRES_PASSWORD: postgres
@@ -478,7 +478,7 @@ jobs:
   #   timeout-minutes: 15
   #   services:
   #     postgres:
-  #       image: timescale/timescaledb-ha:pg16
+  #       image: postgres:16
   #       env:
   #         POSTGRES_USER: postgres
   #         POSTGRES_PASSWORD: postgres
@@ -534,7 +534,7 @@ jobs:
     if: github.event.pull_request.draft == false || github.event_name != 'pull_request'
     services:
       postgres:
-        image: timescale/timescaledb-ha:pg16
+        image: postgres:16
         env:
           POSTGRES_USER: postgres
           POSTGRES_PASSWORD: postgres
@@ -594,20 +594,9 @@ jobs:
       - uses: actions/checkout@v4
       - name: Select Xcode
         run: sudo xcode-select -switch /Applications/Xcode_$(cat $GITHUB_WORKSPACE/.xcode-version).app
-      - name: Set up PostgreSQL with TimescaleDB
+      - name: Set up PostgreSQL
         run: |
-          brew tap timescale/tap
-          brew install timescaledb
-          # Run timescaledb_move.sh to install extension files to PostgreSQL
-          /opt/homebrew/bin/timescaledb_move.sh || true
-          # Stop PostgreSQL before configuring
-          if brew services list | grep -q "^postgresql@17\\s\\+started"; then
-            brew services stop postgresql@17
-            sleep 2
-          fi
-          # Configure TimescaleDB - specify the correct PostgreSQL 17 config path
-          timescaledb-tune --quiet --yes --pg-config /opt/homebrew/opt/postgresql@17/bin/pg_config
-          # Start PostgreSQL with the new shared_preload_libraries config
+          brew install postgresql@17
           brew services start postgresql@17
           # Wait for PostgreSQL to start (check via TCP)
           for i in {1..30}; do
@@ -620,8 +609,6 @@ jobs:
           done
           # Create runner user for database access
           /opt/homebrew/opt/postgresql@17/bin/createuser -h localhost -s runner || true
-          # Verify TimescaleDB extension is available
-          /opt/homebrew/opt/postgresql@17/bin/psql -h localhost -d postgres -c "CREATE EXTENSION IF NOT EXISTS timescaledb; SELECT extversion FROM pg_extension WHERE extname = 'timescaledb';"
       - uses: jdx/mise-action@v3.2.0
         with:
           working_directory: .

AGENTS.md

@@ -80,7 +80,7 @@ Tuist Server is an Elixir/Phoenix web application that extends the functionality
 **Key Technologies:**
 - **Backend**: Elixir 1.18.3 with Phoenix 1.7.12 framework
 - **Databases**: 
-  - PostgreSQL with TimescaleDB extension (primary database)
+  - PostgreSQL (primary database)
   - ClickHouse (analytics database, write-only through IngestRepo)
 - **Frontend**: Phoenix LiveView with JavaScript/TypeScript and esbuild
 - **Package Management**: pnpm for JavaScript dependencies
@@ -104,7 +104,7 @@ Tuist Server is an Elixir/Phoenix web application that extends the functionality
 ## Development Setup
 
 **Prerequisites:**
-- PostgreSQL 16 with TimescaleDB extension
+- PostgreSQL 16
 - Mise development environment manager
 - Private key from 1Password for `priv/secrets/dev.key`
 
@@ -234,7 +234,6 @@ The application deploys to Render with different environments:
 
 - Always run `mix ecto.migrate` after pulling database migrations
 - Use `mise run install` after pulling dependency changes
-- The application requires TimescaleDB extension - install it if migrations fail
 - Local development connects to `http://localhost:8080` for Tuist CLI integration
 
 # Tuist Handbook

docs/docs/en/contributors/code/server.md

@@ -13,12 +13,6 @@ Source: [github.com/tuist/tuist/tree/main/server](https://github.com/tuist/tuist
 
 The server powers Tuist’s server-side features like authentication, accounts and projects, cache storage, insights, previews, registry, and integrations (GitHub, Slack, and SSO). It is a Phoenix/Elixir application with Postgres and ClickHouse.
 
-::: warning TIMESCALEDB DEPRECATION
-<!-- -->
-TimescaleDB is deprecated and will be removed. For now, if you need it for local setup or migrations, use the [TimescaleDB installation docs](https://docs.timescale.com/self-hosted/latest/install/installation-macos/).
-<!-- -->
-:::
-
 ## How to contribute {#how-to-contribute}
 
 Contributions to the server require signing the CLA (`server/CLA.md`).

docs/docs/en/guides/server/self-host/install.md

@@ -55,16 +55,9 @@ Tuist server has been tested and is compatible with the following minimum versio
 
 | Component | Minimum Version | Notes |
 | --- | --- | --- |
-| PostgreSQL | 15 | With TimescaleDB extension |
-| TimescaleDB | 2.16.1 | Required PostgreSQL extension (deprecated) |
+| PostgreSQL | 15 | |
 | ClickHouse | 25 | Required for analytics |
 
-::: warning TIMESCALEDB DEPRECATION
-<!-- -->
-TimescaleDB is currently a required PostgreSQL extension for Tuist server, used for time-series data storage and querying. However, **TimescaleDB is deprecated** and will be dropped as a required dependency in the near future as we migrate all time-series functionality to ClickHouse. For now, ensure your PostgreSQL instance has TimescaleDB installed and enabled.
-<!-- -->
-:::
-
 ### Running Docker-virtualized images {#running-dockervirtualized-images}
 
 We distribute the server as a [Docker](https://www.docker.com/) image via [GitHub’s Container Registry](https://docs.github.com/en/packages/working-with-a-github-packages-registry/working-with-the-container-registry).
@@ -73,19 +66,17 @@ To run it, your infrastructure must support running Docker images. Note that mos
 
 ### Postgres database {#postgres-database}
 
-In addition to running the Docker images, you'll need a [Postgres database](https://www.postgresql.org/) with the [TimescaleDB extension](https://www.timescale.com/) to store relational and time-series data. Most infrastructure providers include Postgres databases in their offering (e.g., [AWS](https://aws.amazon.com/rds/postgresql/) & [Google Cloud](https://cloud.google.com/sql/docs/postgres)).
-
-**TimescaleDB Extension Required:** Tuist requires the TimescaleDB extension for efficient time-series data storage and querying. This extension is used for command events, analytics, and other time-based features. Ensure your PostgreSQL instance has TimescaleDB installed and enabled before running Tuist.
+In addition to running the Docker images, you'll need a [Postgres database](https://www.postgresql.org/) to store relational data. Most infrastructure providers include Postgres databases in their offering (e.g., [AWS](https://aws.amazon.com/rds/postgresql/) & [Google Cloud](https://cloud.google.com/sql/docs/postgres)).
 
 ::: info MIGRATIONS
 <!-- -->
-The Docker image's entrypoint automatically runs any pending schema migrations before starting the service. If migrations fail due to a missing TimescaleDB extension, you'll need to install it in your database first.
+The Docker image's entrypoint automatically runs any pending schema migrations before starting the service.
 <!-- -->
 :::
 
 ### ClickHouse database {#clickhouse-database}
 
-Tuist uses [ClickHouse](https://clickhouse.com/) for storing and querying large amounts of analytics data. ClickHouse is **required** for features like build insights and will be the primary time-series database as we phase out TimescaleDB. You can choose whether to self-host ClickHouse or use their hosted service.
+Tuist uses [ClickHouse](https://clickhouse.com/) for storing and querying large amounts of analytics data. ClickHouse is **required** for features like build insights. You can choose whether to self-host ClickHouse or use their hosted service.
 
 ::: info MIGRATIONS
 <!-- -->
@@ -301,7 +292,7 @@ On top of the `TUIST_GITHUB_APP_CLIENT_ID` and `TUIST_GITHUB_APP_CLIENT_SECRET`,
 
 We provide a comprehensive Docker Compose configuration that includes all required dependencies for testing Tuist server on your local machine before deploying to your infrastructure:
 
-- PostgreSQL 15 with TimescaleDB 2.16 extension (deprecated)
+- PostgreSQL 15
 - ClickHouse 25 for analytics
 - ClickHouse Keeper for coordination
 - MinIO for S3-compatible storage

docs/docs/public/server/self-host/docker-compose.yml

@@ -3,9 +3,9 @@
 # with all dependencies included (PostgreSQL, ClickHouse, MinIO, Redis)
 
 services:
-  # PostgreSQL with TimescaleDB extension
+  # PostgreSQL
   postgres:
-    image: timescale/timescaledb-ha:pg16
+    image: postgres:16
     container_name: tuist-postgres
     restart: unless-stopped
     environment:

server/AGENTS.md

@@ -7,7 +7,7 @@ Tuist Server is an Elixir/Phoenix web application that extends the Tuist CLI. It
 
 **Key Technologies**
 - Backend: Elixir 1.18.3 with Phoenix 1.7.12
-- Databases: PostgreSQL with TimescaleDB (primary), ClickHouse (analytics; write via IngestRepo, read via ClickHouseRepo)
+- Databases: PostgreSQL (primary), ClickHouse (analytics; write via IngestRepo, read via ClickHouseRepo)
 - Frontend: Phoenix LiveView with JavaScript/TypeScript and esbuild
 - Package management: pnpm for JavaScript dependencies
 
@@ -29,7 +29,7 @@ Tuist Server is an Elixir/Phoenix web application that extends the Tuist CLI. It
 
 ## Development Setup
 **Prerequisites**
-- PostgreSQL 16 with TimescaleDB extension
+- PostgreSQL 16
 - Mise development environment manager
 - Private key from 1Password for `priv/secrets/dev.key`
 
@@ -115,7 +115,6 @@ mise run dev
 ## Important Notes
 - Run `mix ecto.migrate` after pulling migrations.
 - Use `mise run install` after dependency changes.
-- TimescaleDB extension is required.
 - Local development connects to `http://localhost:8080` for Tuist CLI integration.
 
 ## Data Export Documentation

server/README.md

@@ -11,7 +11,6 @@ Contributions to the Tuist Server require signing a Contributor License Agreemen
 ### Requirements
 
 - [Postgres](https://formulae.brew.sh/formula/postgresql@16)
-- [TimescaleDB](https://docs.timescale.com/self-hosted/latest/install/installation-macos/)
 - [Mise](https://mise.jdx.dev/)
 
 ### Set up
@@ -41,5 +40,4 @@ Pass: tuistrocks
 1. Run `tuist auth` to authenticate.
 1. You are now connected to the local Tuist Server!  You can try running `tuist cache` and see the binaries being uploaded.
 
-> [!IMPORTANT]
-> If the execution of database migrations fails because the TimescaleDB extension is not installed, you'll have to [install the extension](https://docs.timescale.com/self-hosted/latest/install/installation-macos/#set-up-the-timescaledb-extension) in the `tuist_development` database.
+

server/data-export.md

@@ -37,11 +37,16 @@ Sensitive authentication data (passwords, tokens) are excluded from exports.
 - Alert rules (name, category, metric, deviation thresholds, Slack channel configuration)
 - Alert history (triggered alerts with current/previous values, timestamps)
 
-### Analytics Data
+### Analytics Data (ClickHouse)
+The following data is stored in ClickHouse for analytics purposes:
+- **Build runs** (`build_runs` table): Complete build execution data including duration, status, cache statistics, CI metadata, git information, and custom tags
+- **Build issues** (`build_issues` table): Compilation warnings and errors from builds
+- **Build files** (`build_files` table): Individual file compilation metrics
+- **Build targets** (`build_targets` table): Target/module build performance
+- **Cacheable tasks** (`cacheable_tasks` table): Xcode cache task analytics with hit/miss status
+- **CAS outputs** (`cas_outputs` table): Content-addressable storage upload/download records
 - Build performance metrics
-- Build issues and compilation data
 - QA testing logs and results
-- Build runs with cache hit/miss statistics (cacheable_task_remote_hits_count, cacheable_task_local_hits_count, cacheable_tasks_count)
 
 ### Non-Exportable Data
 - Swift package registry data (shared community resources)

server/docker-compose.yml

@@ -1,7 +1,7 @@
 version: '3.8'
 services:
   db:
-    image: timescale/timescaledb-ha:pg16
+    image: postgres:16
     restart: always
     environment:
       - POSTGRES_USER=postgres

server/lib/mix/tasks/db/create.ex

@@ -1,6 +1,6 @@
 defmodule Mix.Tasks.Db.Create do
   @moduledoc ~S"""
-  This task extends the ecto.create task installing any necessary extensions right after the creation of the datatabase.
+  This task extends the ecto.create task to ensure all repos are started after database creation.
   """
   use Mix.Task
   use Boundary, classify_to: Tuist.Mix
@@ -17,18 +17,6 @@ defmodule Mix.Tasks.Db.Create do
 
     for repo <- repos do
       ensure_repo(repo, args)
-
-      case repo do
-        Tuist.ClickHouseRepo ->
-          :ok
-
-        Tuist.IngestRepo ->
-          :ok
-
-        Tuist.Repo ->
-          {:ok, _} =
-            Ecto.Adapters.SQL.query(repo, "CREATE EXTENSION IF NOT EXISTS timescaledb", [])
-      end
     end
   end
 end