Skip to content

test comment #2170

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
timburke-hackit wants to merge 1 commit into from
Closed

test comment #2170

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 7 additions & 5 deletions lambdas/govnotify_api_ingestion_repairs/main.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,21 +1,23 @@
# test
"""
Script to call the GovNotify API to retrieve data and write to S3.
Retrieved data is written to S3 Landing as a json string and parquet file.
Data is then normalised and written to s3 Raw for use by analysts.
Both zones are crawled so that data is exposed in the Glue data catalog.
"""

from datetime import datetime
from io import BytesIO
import json
import logging
from datetime import datetime
from io import BytesIO
from os import getenv

from botocore.exceptions import ClientError
import boto3
from notifications_python_client.notifications import NotificationsAPIClient
from notifications_python_client.errors import HTTPError
import pandas as pd
from botocore.exceptions import ClientError
from notifications_python_client.errors import HTTPError
from notifications_python_client.notifications import NotificationsAPIClient


# Set up logging
logging.basicConfig(level=logging.INFO)
Expand Down