#office-hours - November 2021

My Q&A Questions
1. Suppose you have a K8S cluster per team, would you do a VPC per cluster ? Or VPC per stage (Prod/staging/testing) ?

2. How to pass information between Terraform and the Helm Chart (deployed via Argo) ?
a. For Testing/QA we have DB Snapshot Volumes that we will use Terraform to clone, and pass it for the HelmChart
b. The HelmChart then uses to create a PV & PVC for the DB Pod.

@here office hours is starting in 30 minutes! Remember to post your questions here.

C. Moser has joined Public "Office Hours"

Michael Bottoms has joined Public "Office Hours"

Vlad Ionescu has joined Public "Office Hours"

Andy Miguel (Cloud Posse) has joined Public "Office Hours"

David Hawthorne has joined Public "Office Hours"

Eric Berg has joined Public "Office Hours"

Brandon vh has joined Public "Office Hours"

Yusuf has joined Public "Office Hours"

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

Mohammed Almusaddar has joined Public "Office Hours"

links from today's session:
• https://github.com/doitintl/kube-no-trouble
• https://aws.amazon.com/about-aws/whats-new/2021/10/amazon-eks-nodes-groups-bottlerocket/
• https://reinvent.awsevents.com/justify-your-trip/?trk=www.google.com
• https://www.youtube.com/watch?v=-MmRf27UEWM
• https://aws.amazon.com/about-aws/whats-new/2021/11/aws-secrets-manager-increases-secrets-limit-per-account/
• https://aws.amazon.com/about-aws/whats-new/2021/10/aws-fargate-amazon-ecs-windows-containers/
• https://aws.amazon.com/blogs/networking-and-content-delivery/amazon-cloudfront-introduces-response-headers-policies/
• https://cloudposse.atlassian.net/wiki/spaces/REFARCH/pages/1192493057/How+to+Manage+EKS+Cluster+Addons

Daniel Miller (CloudPosse) has joined Public "Office Hours"

Jim Park has joined Public "Office Hours"

Max Lobur has joined Public "Office Hours"

C. Moser has joined Public "Office Hours"

Sherif Abdel-Naby has joined Public "Office Hours"

Benjamin Smith has joined Public "Office Hours"

Marc Tamsky has joined Public "Office Hours"

Tim Gourley has joined Public "Office Hours"

Mazin Ahmed has joined Public "Office Hours"

Loren Gordon has joined Public "Office Hours"

Michael Bottoms has joined Public "Office Hours"

Mauricio Wyler has joined Public "Office Hours"

Michael Jenkins has joined Public "Office Hours"

Andrew Thompson has joined Public "Office Hours"

Oskar Maria Grande has joined Public "Office Hours"

Nian Wang has joined Public "Office Hours"

Guilherme Borges has joined Public "Office Hours"

From @Vlad Ionescu (he/him) in zoom

https://github.com/bottlerocket-os/bottlerocket is interesting and more in-depth that the usual blogs

Gerard Ceraso has joined Public "Office Hours"

Hao Wang has joined Public "Office Hours"

venkata mutyala has joined Public "Office Hours"

Andy Roth has joined Public "Office Hours"

This is a cool thing for those who are on GCP
https://cloud.google.com/blog/products/containers-kubernetes/introducing-container-image-streaming-in-gke

Antarr Byrd has joined Public "Office Hours"

emem peace has joined Public "Office Hours"

emem peace has joined Public "Office Hours"

emem peace has joined Public "Office Hours"

Yusuf has joined Public "Office Hours"

Mauricio Wyler has joined Public "Office Hours"

Sherif Abdel-Naby has joined Public "Office Hours"

Guilherme Borges has joined Public "Office Hours"

Guilherme Borges has joined Public "Office Hours"

@here office hours is starting in 30 minutes! Remember to post your questions here.

Anton Babenko has joined Public "Office Hours"

Anton Babenko has joined Public "Office Hours"

Justin Davis has joined Public "Office Hours"

Michael Bottoms has joined Public "Office Hours"

Andy Miguel (Cloud Posse) has joined Public "Office Hours"

Tim Gourley has joined Public "Office Hours"

Jim Park has joined Public "Office Hours"

Max Lobur has joined Public "Office Hours"

Guilherme Borges has joined Public "Office Hours"

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

Mauricio Wyler has joined Public "Office Hours"

Michael Holt has joined Public "Office Hours"

Uzuazoraro Etobro has joined Public "Office Hours"

Aleksandr Fofanov has joined Public "Office Hours"

Matt Calhoun has joined Public "Office Hours"

Alexandr Vorona has joined Public "Office Hours"

Geoff Weinhold has joined Public "Office Hours"

Oliver Schoenborn has joined Public "Office Hours"

Paul Bullock has joined Public "Office Hours"

Mike Martin has joined Public "Office Hours"

Christian Roy has joined Public "Office Hours"

Sherif Abdel-Naby has joined Public "Office Hours"

Sherif Abdel-Naby has joined Public "Office Hours"

James Haughey has joined Public "Office Hours"

links from today's session:
• https://www.sec.gov/Archives/edgar/data/1720671/000119312521319849/d205906ds1.htm
• https://news.ycombinator.com/item?id=29110444
• https://github.com/hashicorp/terraform-provider-aws/releases/tag/v3.64.0
• https://aws.amazon.com/blogs/aws/goodbye-microsoft-sql-server-hello-babelfish/
• https://ghuntley.com/sudo-rm-rf/
• https://grafana.com/blog/2021/11/09/announcing-grafana-oncall/
• https://github.com/gruntwork-io/terratest/releases/tag/v0.38.1
• https://aws.amazon.com/about-aws/whats-new/2021/11/aws-lambda-support-cross-account-image-amazon-elastic-container-registry/
• https://aws.amazon.com/about-aws/whats-new/2021/10/amazon-ec2-amazon-machine-images-organizations/
• https://discuss.hashicorp.com/t/request-for-feedback-config-driven-refactoring/30730
• https://github.com/hashicorp/terraform/releases/tag/v1.1.0-beta1
• https://github.com/cloudposse/terraform-aws-eks-node-group/pull/93

Tony Scott has joined Public "Office Hours"

venkata mutyala has joined Public "Office Hours"

Matt Gowie has joined Public "Office Hours"

Vicken Simonian has joined Public "Office Hours"

Marc Tamsky has joined Public "Office Hours"

Ross Rfd has joined Public "Office Hours"

Mike Martin has joined Public "Office Hours"

Yuri Lima has joined Public "Office Hours"

Blaise pabon has joined Public "Office Hours"

Does the 15 min runtime limit start from beginning or end of downloading the image? 🧌

Eric Berg has joined Public "Office Hours"

How do you suggest doing DB Snapshot Dump and Restore from Production to Dev/Staging/QA envs ?

Yea way we do it for preview environments that we dump DB from prod to staging, do the tokenization, and then take a EBS Snapshots from this. The we create volumes from it on each preview environment deployment and create its PV and PVCs.

It's quick, take about 2~3 mins to restore, and dump is done daily at night.

Was just asking if there is other ways of doing that 😃

Nope, it sounds correct 🙂 The only thing that I would change here is doing the tokenization in prod to decrease threat radius.

Question: are there any SQL database (postgres compat) solutions which run in AWS (EC2 or EKS), and outperform AWS Aurora in terms of write speeds, replication speeds, and overall performance?

@here office hours is starting in 30 minutes! Remember to post your questions here.

Question: On moving away from Terragrunt, and completely into native Terraform, what are good resources to learn about how to split Terraform workspaces for infrastructure? We are using a centralized infrastructure-live repository but would like to reduce both the blast radius and time to plan/apply (e.g. separate repositories for tf-networking, tf-messaging...).

Also, how to organize infra repositories taking multi-region/multi-account into consideration (replied in thread)

Patrick Jahns has joined Public "Office Hours"

Curious how many dev teams are using conventional commits at all --> https://www.conventionalcommits.org/en/v1.0.0/

Tony Scott has joined Public "Office Hours"

Vigneshkumar Sadasivam has joined Public "Office Hours"

Guilherme Borges has joined Public "Office Hours"

Andy Miguel (Cloud Posse) has joined Public "Office Hours"

James Haughey has joined Public "Office Hours"

Mike Martin has joined Public "Office Hours"

Andy Roth has joined Public "Office Hours"

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

Matt Calhoun has joined Public "Office Hours"

Max Lobur has joined Public "Office Hours"

Marc Tamsky has joined Public "Office Hours"

Michael Bottoms has joined Public "Office Hours"

Zachary Loeber has joined Public "Office Hours"

Matt Gowie has joined Public "Office Hours"

Michael Manganiello has joined Public "Office Hours"

links from today's session:
• https://www.nrc.nl/nieuws/2021/11/10/american-spy-hacked-bookingcom-company-stayed-silent-a4065086
• https://twitter.com/spamhaus/status/1459450061696417792?s=21
• https://blog.argoproj.io/argo-cd-v2-2-release-candidate-4e16e985b486
• https://medium.com/google-cloud/resource-factories-a-descriptive-approach-to-terraform-581b3ebb59c
• https://github.com/keilerkonzept/terraform-module-versions

Tim Gourley has joined Public "Office Hours"

Matt Andreo has joined Public "Office Hours"

Hramp has joined Public "Office Hours"

Ola Ade has joined Public "Office Hours"

Hao Wang has joined Public "Office Hours"

Vicken Simonian has joined Public "Office Hours"

Patrick Joyce has joined Public "Office Hours"

Leia Renée has joined Public "Office Hours"

Ross Rfd has joined Public "Office Hours"

Ray Myers has joined Public "Office Hours"

Michael Holt has joined Public "Office Hours"

Florain Drescher has joined Public "Office Hours"

Question: How do you bootstrap IAM/service/machine roles for CICD and allow the repository to self manage?
example: A repository of terraform files deployed with github actions, with n number of environments. A single IAM role is assumed by the action, how can I bootstrap this role and allow it to be updated by a workflow in the same repo? ( I asked this question in #terraform and received great responses, just for discussion )

@here office hours is starting in 30 minutes! Remember to post your questions here.

Jim Park has joined Public "Office Hours"

r b has joined Public "Office Hours"

Matt Andreo has joined Public "Office Hours"

Erik Osterman (Cloud Posse) has joined Public "Office Hours"

David Hawthorne has joined Public "Office Hours"

Andy Miguel (Cloud Posse) has joined Public "Office Hours"

Vlad Ionescu has joined Public "Office Hours"

Max Lobur has joined Public "Office Hours"

Matt Calhoun has joined Public "Office Hours"

Paul Bullock has joined Public "Office Hours"

Oscar Blanco has joined Public "Office Hours"

Alexandr Vorona has joined Public "Office Hours"

Luis Masaya has joined Public "Office Hours"

Guilherme Borges has joined Public "Office Hours"

Benjamin Smith has joined Public "Office Hours"

I'm going to Re:Invent! CloudPosse meetup?

links from today's session:
• https://app.netlify.com/drop
• https://www.vladionescu.me/posts/flowchart-how-should-i-run-containers-on-aws-2021/
• https://github.com/kubevious/kubevious

@Matt Gowie has a module for it https://github.com/masterpointio/terraform-aws-amplify-app (following cloudposse conventions)

Patrick Joyce has joined Public "Office Hours"

Dale-Kurt Murray has joined Public "Office Hours"

Michael Manganiello has joined Public "Office Hours"

Guilherme Borges has joined Public "Office Hours"

@Vlad Ionescu (he/him) reminded me

Blaise pabon has joined Public "Office Hours"

Antarr Byrd has joined Public "Office Hours"

Andrew Thompson has joined Public "Office Hours"

Brandon vh has joined Public "Office Hours"

James Haughey has joined Public "Office Hours"

Eric Berg has joined Public "Office Hours"

Also https://github.com/aws-actions/configure-aws-credentials and https://docs.github.com/en/actions/deployment/security-hardening-your-deployments/configuring-openid-connect-in-amazon-web-services

Anand Gautam has joined Public "Office Hours"

https://contribute.dev and http://gitpod.io/#https://github.com/poc-hello-world/greeter-service