Ost 408 feat global & perso recommendations#18
Closed
spideystreet wants to merge 202 commits intostagingfrom
Closed
Ost 408 feat global & perso recommendations#18spideystreet wants to merge 202 commits intostagingfrom
spideystreet wants to merge 202 commits intostagingfrom
Conversation
- Update Dagster job descriptions to focus on orchestration flow - Clarify classification asset docstrings - Enhance DBT ML model descriptions (stg/pvt) to explain business logic over implementation details
- Add multi-stage Dockerfile (Go builder + Python Runtime) - Add docker-compose.yml with pgvector support - Add .dockerignore
…for cpu usage in docker
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Feature : Embeddings, Classification & Recommandation
Grosse PR qui met en place : calcul d'embeddings vectoriels, classification automatique par SLM et moteur de recommandation (User <-> Project).
Docker & DevOps
scripts/init.sh) : Nouvel entrypoint qui gère l'install des deps dbt et lancedbt buildau démarrage. Fini les crashsrelation does not exist!Go Services (Refactor)
fetcher(récupération brute) etscraper(logique métier)common.goData Engineering & ML (Dagster)
good-first-issues > 5, activité < 24h, stars 500..1K) pour garantir des projets vivants et qualitécore_github__detect_languages)LLMClassifierResourceSentenceTransformerrun_all_jobplanifié toutes les 6h pour commencerTransformation (dbt & SQL)
clean_text,jsonb_to_list) pour préparer le terrain au MLbuild_project_contextbuild_user_contextpour maximiser la pertinence des embeddingsmatch_global_recommendation: Reco globale, Top 5 (Trending/Récents)match_user_recommendation: Recos persos (Cosine Similarity surpgvector)DB (Prisma & Postgres)
public,github,match,ml)vectoret support Prisma viaUnsupported("vector(384)")npm run seedfonctionne enfin en local sans pleurerImportant
@Olyxz :
pgvectorest bien activée sur staging