Scrum 151 ci cd with GitHub actions

[QuanUTS]

No description provided.

[QuanUTS]

Model evaluation metrics on 3 subsets:

Subset	Loss	Accuracy	Top-5 Accuracy
Train	0.0423969	0.993065	1
Validation	2.05219	0.591716	0.831361
Test	2.32801	0.488372	0.837209

You can view full task results here

[QuanUTS]

Model evaluation metrics on 3 subsets:

Subset	Loss	Accuracy	Top-5 Accuracy
Train	0.00969788	0.998613	1
Validation	2.2651	0.60355	0.872781
Test	2.34377	0.573643	0.841085

You can view full task results here

[Copilot]

Pull Request Overview

This PR enhances the CI/CD pipeline for the SyntaxSquad ML Pipeline by updating dependency versions, refactoring Python reporting logic, and consolidating GitHub Actions workflows for improved automation.

• Updated dependency definitions in requirements.txt to use flexible specifiers.
• Refactored pipeline reporting functions to generate clearer PR comments and added a new "get_reported_table" function.
• Adjusted workflow steps in the GitHub Actions pipeline, including splitting job responsibilities and increasing the wait time for FastAPI startup.

Reviewed Changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 2 comments.

File	Description
serving/requirements.txt	Updated dependency specifications for FastAPI and numpy.
cicd/pipeline_reports.py	Refactored functions to improve reporting of ClearML task metrics.
.github/workflows/pipeline.yaml	Modified CI/CD workflow steps and added a new job to test remote tasks, updated deployment wait time.
.github/workflows/ci.yaml	Removed outdated CI workflow configuration as it's been consolidated.

[Copilot]

Consider removing the extra space around '==' in the numpy dependency to avoid potential installation issues; it should be 'numpy==1.26.4'.

Suggested change

	numpy == 1.26.4
	numpy==1.26.4

[Copilot]

Instead of a fixed long sleep duration, consider implementing a polling mechanism to check for FastAPI server readiness to optimize pipeline execution time.

Suggested change

	sleep 240 # Wait for 4 minutes to start the server and download artifacts
	curl -f http://localhost:$FASTAPI_PORT/health || exit 1 # Verify the server is running
	# Poll the FastAPI server's health endpoint until it is ready or timeout is reached
	for i in {1..60}; do # Retry up to 60 times (1 minute timeout with 1-second intervals)
	if curl -f http://localhost:$FASTAPI_PORT/health; then
	echo "FastAPI server is ready!"
	break
	fi
	echo "Waiting for FastAPI server to be ready... (attempt $i)"
	sleep 1
	done
	if ! curl -f http://localhost:$FASTAPI_PORT/health; then
	echo "FastAPI server failed to start within the timeout period."
	exit 1
	fi