Criando Lambda Functions para Ingerir Dados de APIs com AWS CDK

Related tags

Third-party APIs Wrappers LIVE001-Criando-Lambda-Functions-para-Ingerir-Dados-de-APIs
Overview

LIVE001 - AWS Lambda para Ingerir Dados de APIs

  • Fazer o deploy de uma função lambda com infraestrutura como código
  • Lambda vai numa API externa e extrai dados e salva para o S3 (data lake)

O que é AWS Lambda

Serviço de computação serverless da AWS.

Infraestrutura como código

Declarar a infraestrutura da sua cloud usando código. Benefícios:

  • Velocidade
  • Confiabilidade
  • Controle de versão
  • Múltiplos ambientes

Cloudformation e CDK

Cloudformation é o sistema para você declarar a sua infraestrutura e gerenciar os seus recursos na nuvem. CDK é uma biblioteca para você declarar e gerenciar infraestrutura como código usando uma luinguagem de programação.

You might also like...
Esse script procura qualquer, dados que você queira na wikipedia! Em breve traremos um com dados em toda a internet.
Esse script procura qualquer, dados que você queira na wikipedia! Em breve traremos um com dados em toda a internet.

Buscador de dados simples Dependências necessárias Para você poder começar a utilizar esta ferramenta, você vai precisar da dependência "wikipedia", p

Erick Campoy 4 Feb 24, 2022
SSH-Restricted deploys an SSH compliance rule (AWS Config) with auto-remediation via AWS Lambda if SSH access is public.
SSH-Restricted deploys an SSH compliance rule (AWS Config) with auto-remediation via AWS Lambda if SSH access is public.

SSH-Restricted SSH-Restricted deploys an SSH compliance rule with auto-remediation via AWS Lambda if SSH access is public. SSH-Auto-Restricted checks

Adrian Hornsby 30 Nov 8, 2022
POC de uma AWS lambda que executa a consulta de preços de criptomoedas, e é implantada na AWS usando Github actions.
POC de uma AWS lambda que executa a consulta de preços de criptomoedas, e é implantada na AWS usando Github actions.

Cryptocurrency Prices Overview Instalação Repositório Configuração CI/CD Roadmap Testes Overview A ideia deste projeto é aplicar o conteúdo estudado s

Gustavo Santos 3 Aug 31, 2022
AWS-serverless-starter - AWS Lambda serverless stack via Serverless framework
AWS-serverless-starter - AWS Lambda serverless stack via Serverless framework

Serverless app via AWS Lambda, ApiGateway and Serverless framework Configuration

Bəxtiyar 3 Feb 2, 2022
A python library for creating Slack slash commands using AWS Lambda Functions

slashbot Slashbot makes it easy to create slash commands using AWS Lambda functions. These can be handy for creating a secure way to execute automated

Eric Brassell 17 Oct 21, 2022
This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.
This solution helps you deploy Data Lake Infrastructure on AWS using CDK Pipelines.

CDK Pipelines for Data Lake Infrastructure Deployment This solution helps you deploy data lake infrastructure on AWS using CDK Pipelines. This is base

AWS Samples 66 Nov 23, 2022
Deploy a STAC API and a dynamic mosaic tiler API using AWS CDK.

Earth Observation API Deploy a STAC API and a dynamic mosaic tiler API using AWS CDK.

Development Seed 39 Oct 30, 2022
Recommended AWS CDK project structure for Python applications
Recommended AWS CDK project structure for Python applications

Recommended AWS CDK project structure for Python applications The project implements a user management backend component that uses Amazon API Gateway,

AWS Samples 110 Jan 6, 2023
This repository contains code written in the AWS Cloud Development Kit (CDK)
This repository contains code written in the AWS Cloud Development Kit (CDK)

This repository contains code written in the AWS Cloud Development Kit (CDK) which launches infrastructure across two different regions to demonstrate using AWS AppSync in a multi-region setup.

AWS Samples 5 Jun 3, 2022
Comments
  • LIVE-003/Cria-pull-request-automatico

    LIVE-003/Cria-pull-request-automatico

    ISSUE INFORMATION

    Please check the following GitHub issues to find out more about this PR:

    • https://github.com/andresionek91/LIVE001-Criando-Lambda-Functions-para-Ingerir-Dados-de-APIs/issues/1

    Checklist

    • [x] Does the commit messages reference the GitHub issue? (i.e. ISSUE-1/commit message)
    • [x] Does the commit message explain the change made?
    • [x] Did you deploy to staging/UAT?
    • [x] Were the changes approved by the stakeholders?

    What?

    Fix issue on PR creation

    Why?

    How?

    Testing?

    Documentation?

    Anything Else?

    opened by github-actions[bot] 0
  • LIVE-003/Cria-pull-request-automatico

    LIVE-003/Cria-pull-request-automatico

    ISSUE INFORMATION

    Please check the following GitHub issues to find out more about this PR:

    • https://github.com/andresionek91/LIVE001-Criando-Lambda-Functions-para-Ingerir-Dados-de-APIs/issues/1

    Checklist

    • [x] Does the commit messages reference the GitHub issue? (i.e. ISSUE-1/commit message)
    • [x] Does the commit message explain the change made?
    • [x] Did you deploy to staging/UAT?
    • [x] Were the changes approved by the stakeholders?

    What?

    Fix bug on action

    Why?

    N/A

    How?

    N/A

    Testing?

    N/A

    Documentation?

    N/A

    Anything Else?

    N/A

    opened by github-actions[bot] 0
  • LIVE-003/Cria-pull-request-automatico

    LIVE-003/Cria-pull-request-automatico

    ISSUE INFORMATION

    Please check the following GitHub issues to find out more about this PR:

    • https://github.com/andresionek91/LIVE001-Criando-Lambda-Functions-para-Ingerir-Dados-de-APIs/issues/1

    Checklist

    • [x] Does the commit messages reference the GitHub issue? (i.e. #1/commit message)
    • [x] Does the commit message explain the change made?
    • [x] Did you deploy to staging/UAT?
    • [x] Were the changes approved by the stakeholders?

    What?

    Automate the creation of pull requests

    Why?

    To make our lives easier

    How?

    Because I'm lazy

    Testing?

    Yes, the action works

    Documentation?

    N/A

    Anything Else?

    N/A

    opened by github-actions[bot] 0
Owner
Andre Sionek
A little bit of each: Data engineer and scientist, entrepreneur, physicist, writer, designer, developer.
Andre Sionek
GitHub
CloudFormation template and CDK stack that contains a CustomResource with Lambda function to allow the setting of the targetAccountIds attribute of the EC2 Image Builder AMI distribution settings which is not currently supported (as of October 2021) in CloudFormation or CDK.

ec2-imagebuilder-ami-share CloudFormation template and CDK stack that contains a CustomResource with Lambda function to allow the setting of the targe

AWS Samples 2 Oct 22, 2022
aws-lambda-scheduler lets you call any existing AWS Lambda Function you have in a future time.

aws-lambda-scheduler aws-lambda-scheduler lets you call any existing AWS Lambda Function you have in the future. This functionality is achieved by dyn

Oğuzhan Yılmaz 57 Dec 17, 2022
Python + AWS Lambda Hands OnPython + AWS Lambda Hands On

Python + AWS Lambda Hands On Python Criada em 1990, por Guido Van Rossum. "Bala de prata" (quase). Muito utilizado em: Automatizações - Selenium, Beau

Marcelo Ortiz de Santana 8 Sep 9, 2022
Aws-lambda-requests-wrapper - Request/Response wrapper for AWS Lambda with API Gateway

AWS Lambda Requests Wrapper Request/Response wrapper for AWS Lambda with API Gat

null 1 May 20, 2022
Cdk-python-crud-app - CDK Python CRUD App

Welcome to your CDK Python project! You should explore the contents of this proj

Shapon Sheikh 1 Jan 12, 2022
A suite of utilities for AWS Lambda Functions that makes tracing with AWS X-Ray, structured logging and creating custom metrics asynchronously easier

A suite of utilities for AWS Lambda Functions that makes tracing with AWS X-Ray, structured logging and creating custom metrics asynchronously easier

Amazon Web Services - Labs 1.9k Jan 7, 2023
Project template for using aws-cdk, Chalice and React in concert, including RDS Postgresql and AWS Cognito

What is This? This repository is an opinonated project template for using aws-cdk, Chalice and React in concert. Where aws-cdk and Chalice are in Pyth

Rasmus Jones 4 Nov 7, 2022
AWS Blog post code for running feature-extraction on images using AWS Batch and Cloud Development Kit (CDK).

Batch processing with AWS Batch and CDK Welcome This repository demostrates provisioning the necessary infrastructure for running a job on AWS Batch u

AWS Samples 7 Oct 18, 2022
Lambda-function - Python codes that allow notification of changes made to some services using the AWS Lambda Function

AWS Lambda Function This repository contains python codes that allow notificatio

Elif Apaydın 3 Feb 11, 2022
Automated AWS account hardening with AWS Control Tower and AWS Step Functions

Automate activities in Control Tower provisioned AWS accounts Table of contents Introduction Architecture Prerequisites Tools and services Usage Clean

AWS Samples 20 Dec 7, 2022