SIRENE bugfixes
Other improvements
- Geodata:
- Localdata: warn of localdata deprecation & skip test_get_local_data_latest test by @tgrandje in #297
- maximize setuptools version by @tgrandje in #302
- bug fixes after IGN API changes + St-Pierre et Miquelon islands included
- bug fixes after INSEE API changes
Bugfixes
- support parquet files in downloads (#257)
- correct column handling in
get_series_list(#259) - correct documentation about
init_conn(#260)
Breaking changes
The INSEE APIs were changed, including
- new API portal: portail-api.insee.fr
- no token generation is needed for all APIs except SIRENE
- for SIRENE API, it is now provided via the
sirene_keyargument ininit_conn get_included_areawas removed
Deprecations
GeoFrDataFrame.translateis deprecated in favor ofGeoFrDataFrame.transform_overseasGeoFrDataFrame.get_geomis deprecated in favor ofGeoFrDataFrame.geometry.union_all
New features
GeoFrDataFrameinherits fromgeopandas.GeoDataFrameso you can use all the included methods directly on it (#246)- the tranlation and zoom of overseas department has be renamed
transform_overseas - the configuration file is no longer stored in the middle of the home directory (#210)
Documentation
- updated examples and user guides (#246 #250 #251)
- internal links for functions and classes (#251)
- link to pandas/geopandas/pyproj and request documentations (#251)
Under the hood
- use data from Melodi api (#229)
- backend function update in the utils module + sirene functions update
- cleanup of temporary files handling (#206)
- all cached data is now saved as parquet for faster read/write operations (#199 #208 #224)
- switch to multithreading instead of multiprocessing (#216)
- move to pyproject.toml only (#243)
- fix tests and cleanup imports (many commits)
- enforce black formatting (#234)
- sirene module compatible with SIRENE API v3.11
- geodata module compatible with the new IGN's geoplatform
- data cached in parquet files thanks to a new decorator used across modules
- fixes in the docs/examples
- macroeconomic series list can be retrieved even if it is zipped twice
- macroeconomic series can be used even if INSEE adds .TRUE or .FALSE at the end of the identifier
- if RSS feed is failing, the get_last_release returns a warning and not an error
- conda forge releases streamlined
- README.rst deleted and README.md included in package distribution file
- python version badge update in readme
- fix to cope with the double zipping of macroeconomic metadata file containing time series identifiers
- changes in geodata module to switch to the new IGN geoplatform
- tests performed on python 3.8-3.11
- new example in doc gallery on mobility in Paris region + example fixes
- package catches error 429 (request limit on api.insee.fr) and then sleeps
- shapely>= 1.8.0 defined in both setup.py and requirements
- translate method: bug fix due to IGN data flow discontinuity
- package compatible with shapely 2.0 + deprecation warnings removed
- get_area_list provides list of communes, departements etc.
- get_included_area is deprecated, get_descending_area should be used instead
- get_ascending_area returns admnistrative areas containing the area provided as input
- geopandas bugfix: crs is no longer contained in 'crs' column but in 'crsCoord'
- init_conn arguments names changed + proxy server settings have been tested
- error handling messages improved in _request_insee function
- GEOlatest<datasetName>latest used as input of get_local_data returns the latest data available
- pull requests use secrets from repo
- pathlib dependency removed + openpyxl<=3.1.0
- doc update
- license change from open license 2.0 to MIT license
- idbank file download from both French and English webpages on insee.fr
- internal idbank list update
- readme update
- tools to search and download data from INSEE APIs : BDM, LocalData, MetaData, SIRENE
- automatic token generator for api.insee.fr from user's credentials saved locally
- pynsee.download module gives access to more than 1200 stored files on insee.fr
- tools to search and download geographical data from IGN API : administrative limits
- GeoFrDataFrame class with dedicated modules to manipulate overseas departements data
- SireneDataFrame class with a module locating entities thanks to OpenStreetMap
- data is usually saved locally to enhance user experience
- data stored internally in the package (used mostly as backups):
- BDM series list
- BDM datasets list
- local metadata
- activity classification (naf rev2 2008)
- list of definitions
- list of files on insee.fr
- full documentation made with docstring and hosted by ReadTheDocs
- hands-on examples covering all modules displayed in the documentation
- test coverage >90%