scipy minimize generator

[roussel-ryan]

Overview

This pull request introduces a new generic sequential optimization generator, ScipyGenerator, that wraps scipy.optimize.minimize and integrates it with Xopt's ask/tell workflow. It includes comprehensive documentation, an example notebook, and full test coverage. Additionally, it updates the generator registry and navigation to reflect the new functionality, and refactors some imports for consistency.

Integration Model

Xopt evaluates objective functions externally, one point at a time. scipy.optimize.minimize expects an in-process callable objective. ScipyGenerator bridges this mismatch by replaying known evaluations:

1. A cache is built from X.data.
2. minimize is called with an objective wrapper that checks the cache first.
3. If scipy asks for an unseen point, the generator raises an internal signal, exits minimize, and returns that point to Xopt.
4. Xopt evaluates that point and appends the result.
5. On the next step, minimize is called again with the larger cache.

Performance Notes

• Cache reconstruction is O(N) per step, where N is the number of collected evaluations.
• minimize restarts each step, so there is repeated optimizer bookkeeping overhead.
• For expensive evaluations, this overhead is usually negligible.
• For inexpensive evaluations, this overhead can be a significant part of runtime.

Key changes:

New Feature: Generic Scipy Minimize Generator

• Added ScipyGenerator in xopt.generators.sequential.scipy, providing a sequential ask/tell interface to any scipy.optimize.minimize method. The generator bridges the difference between Xopt's external evaluation and scipy's in-process callable objective, including robust caching and replay logic.
• Added tests for ScipyGenerator covering point generation, multiple point error handling, restart/serialization, and direct generator usage in test_scipy.py.
• Included ScipyGenerator in the serialization test suite. [1] [2]

Documentation & Examples

• Added API documentation for ScipyGenerator describing its integration model, performance considerations, and configuration in docs/api/generators/sequential/scipy.md.
• Added a new example notebook docs/examples/sequential/scipy.ipynb demonstrating usage with the Rosenbrock function and showing convergence.
• Updated the algorithms overview and main index to mention the new generic scipy minimize generator. [1] [2]
• Updated navigation in mkdocs.yml to include the new example and API documentation. [1] [2]

Generator Registry & Import Refactoring

• Registered scipy as a generator name and added ScipyGenerator to the dynamic generator import logic and __all__ lists. [1] [2] [3]
• Removed now-unnecessary imports from xopt/generators/scipy/__init__.py and refactored LatinHypercubeGenerator imports for consistency. [1] [2]

[codecov]

Codecov Report

❌ Patch coverage is 97.51244% with 5 lines in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
xopt/generators/sequential/scipy.py	94.04%	1 Missing and 4 partials ⚠️

📢 Thoughts on this report? Let us know!

[roussel-ryan]

@copilot address the coverage, linting and notebook failures

[Copilot]

@copilot address the coverage, linting and notebook failures

Fixed in commits 42f6071 and 57bde15 (approximately):

• Tests (test_serialization_loading[scipy]): get_generator_defaults now handles Pydantic v2 default_factory fields (which set v.default to PydanticUndefined instead of None), resolving the TypeError: Object of type PydanticUndefinedType is not JSON serializable.
• Lint (ruff-format): Fixed x0 ** 2 → x0**2 in the scipy example notebook.
• Lint (end-of-file-fixer): Removed the test artifact .txt files (all_sequential_tests.txt, test_results.txt, test_serialization_results.txt) from git tracking and added them to .gitignore.

[roussel-ryan]

@copilot add tests to achieve needed coverage

[Copilot]

@copilot add tests to achieve needed coverage

Added 8 new tests in the latest commit covering all previously untested branches in scipy.py — scipy.py now has 100% line coverage:

• Validator rejecting whitespace-only method string
• Validator rejecting empty initial_point dict
• _add_data early return on empty DataFrame
• Unknown solver ValueError → RuntimeError conversion
• Non-solver ValueError re-raise
• Convergence path (minimize finishes without requesting a new point)
• Convergence path with constants
• Candidate generation with constants

Also removed a dead-code if v is None: return v branch that was unreachable in Pydantic v2.

[Copilot]

Pull request overview

This pull request adds a new sequential optimization generator, ScipyGenerator, that adapts scipy.optimize.minimize to Xopt’s external ask/tell workflow, and updates tests, docs, and generator registration to support it.

Changes:

• Introduce ScipyGenerator (sequential wrapper around scipy.optimize.minimize) and register it under generator name scipy.
• Add unit tests (including serialization/restart coverage) for the new generator and update existing sequential serialization tests.
• Add documentation + example notebook for ScipyGenerator, and update MkDocs navigation and algorithms/index references; refactor LatinHypercubeGenerator imports/location.

Reviewed changes

Copilot reviewed 13 out of 15 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
xopt/generators/sequential/scipy.py	New ScipyGenerator implementation wrapping scipy.optimize.minimize in a sequential ask/tell pattern
xopt/generators/sequential/init.py	Export ScipyGenerator from the sequential generators package
xopt/generators/init.py	Register ScipyGenerator for dynamic loading; improve defaults handling for default_factory fields
xopt/generators/scipy/init.py	Removes old scipy generator re-exports (package content removed)
xopt/generators/latin_hypercube.py	Adds/relocates LatinHypercubeGenerator under a new import path
xopt/tests/generators/sequential/test_scipy.py	Adds test coverage for ScipyGenerator
xopt/tests/generators/sequential/test_serialization.py	Adds ScipyGenerator to sequential generator serialization/restart tests
xopt/tests/generators/test_latin_hypercube.py	Updates import path for LatinHypercubeGenerator
docs/api/generators/sequential/scipy.md	API documentation page for ScipyGenerator
docs/examples/sequential/scipy.ipynb	New example notebook demonstrating ScipyGenerator usage
docs/examples/other/latin_hypercube.ipynb	Updates import path for LatinHypercubeGenerator and relocates example
mkdocs.yml	Adds new docs + example notebook to navigation; updates Latin Hypercube example path
docs/index.md	Mentions the new scipy sequential generator in the feature list
docs/algorithms.md	Adds ScipyGenerator to algorithms list (but link maintenance needed)
.gitignore	Ignores local test output artifacts

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[nikitakuklev]

FYI I'll try catch up this week