#general - January 2020

also, for the reference arch. link above (https://github.com/cloudposse/reference-architectures) - assuming i'm starting from a blank slate, what version of terraform should i go with? 11 or 12?

what's easiest for registering the "apex" domain? will the provisioning process do it, should i do it in the root account's rt 53, or get it from my regular registrar?

cloudposse looks great, looking forward to giving it a try! Been thinking it should exist but didn't come across it until now (currently using bitnami's kube-prod-runtime but that only gets maintenance releases recently).

I have one question regarding codefresh (non-enterprise) version, does it give a whitelist ip/range for deploying to kubernetes or do you have to leave the master world-readable (0.0.0.0/0)?

nvm... I see it now on the GKE pro $300/mo plan it mentions static ip, so I guess it's only either that or enterprise.

Hey everyone, give a warm welcome to our newest members!
- @Eamon Keane

Good to have you here =)

Hi @Erik Osterman (Cloud Posse) - not sure if this is the right channel for this, but I was wondering if you take community contributions for new modules? I have an NLB module based off of https://github.com/cloudposse/terraform-aws-alb, if you would be interested in taking it over

Sure, I think we can do that.

Can you work with @Andriy Knysh (Cloud Posse) to import it?

(#terraform is probably the better channel for this..)

Hey everyone, give a warm welcome to our newest members!
- @carlos catari

Good to have you here =)

Hey everyone, give a warm welcome to our newest members!
- @Phuc
- @HS
- @Figo Huang

Good to have you here =)

hey guys, i know this is random ask, but has anyone ever had an appgateway fail and not allow you to save anything to it on Azure? Sorry at my last wits with this thing and just trying to figure it out anyway possible

Hey everyone, give a warm welcome to our newest members!
- @Scott

Good to have you here =)

:) great to be here

I’m gonna probably be developing an 8 hour training session on setting up an app on AWS ECS with some of yalls repos. Be happy to share my experience along the way and presentation/blog/training material

@OGProgrammer that sounds awesome! 😃

would love to share what ever materials you provide

Is anyone else here stuck in the hell that is Azure AKS?

Sorry, I mean the 'heck' that is Azure AKS

I've found that the faster and more streamlined I automate workloads in this platform the more I'm punished

no I left AKS in the dust 18 months ago thank god. From the kubernetes release notes I see they're the only cloud provider still patching their storage tire fire in each release.

Hey everyone, give a warm welcome to our newest members!
- @Aleksey Silak
- @Aaron Chu
- @Chris Maxoutis
- @Matheus Hunsche

Good to have you here =)

Hey everyone, give a warm welcome to our newest members!
- @sype
- @Josh Lynn

Good to have you here =)

Hey everyone, give a warm welcome to our newest members!
- @Charlie Le
- @Jubel Han
- @Matt McLane
- @Tom Taubkin
- @Sankara Reddy

Good to have you here =)

Howdy all. What is the relationship between Cloudposse the company and this slack workspace? I saw an invite to join this workspace through a cloudposse github repo

Welcome @David! SweetOps is a community run by Cloud Posse (cloudposse.com). It was started as a place for our users to collaborate and ask questions related to our large collection of open source projects on GitHub (github.com/cloudposse), but also talk shop and get feedback on anything DevOps related.

Beautiful, thanks for the clarification!

I discovered not too long ago that almost every terraform module I've written has a better, open source version from you all (or terraform-aws-modules, which maybe is cloudposse a bit as well?).

I've just gotten started with a few PRs to get my feet wet with contributing on https://github.com/cloudposse/terraform-aws-cloudfront-s3-cdn/pulls. Thanks for all the awesome modules!

we're not directly affiliated with #terraform-aws-modules (a project co-opted in part by @antonbabenko, another prolific contributor). Many users of those modules also use ours.

Hey everyone, give a warm welcome to our newest members!
- @Bernhard Lenz
- @David
- @Nedumaran Rajagopal
- @Rob Rose

Good to have you here =)

@dustinvb I finally joined this slack channel!

Are they chewable? I only do chewable?

haha

Hey everyone, give a warm welcome to our newest members!
- @Philip L Bankier
- @David Hubbell
- @Shawn Petersen

Good to have you here =)

Hey everyone, give a warm welcome to our newest members!
- @Daniel Kempthorne
- @Francisco Rodriguez
- @Wen Lim

Good to have you here =)

Hi guys, i’m was invited here by @sype we are currently working on a AWS foundation projet for a French customer. Hope I’ll find great discussion here.

Hey everyone, give a warm welcome to our newest members!
- @Flo Sloot
- @James Huffman
- @Andrea Benfatto
- @Nghia Nguyen
- @Alexandre
- @muhaha

Good to have you here =)

Anyone here using consul for devops pipelines?

well the kv store at least

@Corey Gale might be

maybe @tamsky

Hi Guys!

Please I'm having a serious problem that is driving me crazy, I will appreciate everyone's help

My Laptop is connected to an OPENVPN hosted on AWS, also I need to connect to a client's company VPN to work from, the problem I'm facing is, Once I connect to the Client's Office VPN, I loose Internet access...Please can anybody help with this?

Sounds like you need a VM for your client

Ya, basically what @Maarten van der Hoef suggests... sounds like their VPN is jacking the default route. If you can control that on the client side, that would be the way to go. If have trouble with that, then @Zachary Loeber suggestion will be the the quick win.

Hey everyone, give a warm welcome to our newest members!
- @vgdub
- @Michael Coffey
- @Paul Nicholson
- @Ravi Bhure

Good to have you here =)

Hi!
I plan to start a blog, but I'd like to make it open source and store everything in git repo. The most important for me are posts written in markdown.
Anyone has experience with this? What would you recommend, any specific tool for generating static pages?

I use hugo with render.com for my test site and github pages for my live site (behind cloudflare) and azure devops for the pipeline just for the heck of it

Hey everyone, give a warm welcome to our newest members!
- @claudemir de Almeida Rosa
- @Ben Mathews
- @jujugrrr
- @SoboL
- @Uzair
- @Vaibhav
- @Alexandr Katulskiy

Good to have you here =)

thank you 🙂 @Bot

Hey everyone, give a warm welcome to our newest members!
- @James Rawlings
- @Sean Johnson
- @kemikal
- @Joseph Omojowo
- @carthewd

Good to have you here =)

Hey everyone, give a warm welcome to our newest members!
- @Bill D
- @caretak3r

Good to have you here =)

looking for reference materials or guides around packaging up terraform code (used to release something) into a docker container, like cloudposse does with geodesic. we don’t need the exact geodesic image, so im playing around with a custom docker image i made

@Andrew Roth does something like we do too

I haven't packaged terraform code in a docker container before. Terraform code goes in a git repo. The container has the tools that executes the code. You pass in creds to pull down the code and execute it

Hey everyone, give a warm welcome to our newest members!
- @ITO Wataru
- @oliver
- @grv

Good to have you here =)

How do contributors work for the cloudposse repos? If I've had a few PRs merged into a repo, would it be okay to ask to be a contributor, or is that meant only for cloudposse employees?

@David feel free to add yourself as a contributor if that's the case 😃

remember to update the README.yaml and rebuild

(and thanks for your contributions!)

Thanks guys, good to be part of this slack channel. Not an expert in terraform, here to learn from y'all since I am moving most of our aws stuff to newest tf and exploring new stuff like workspaces etc. Ofcourse, using cloudposse modules 👍️🏻

welcome @grv and thanks!

@grv you came to the right place! 😃

make sure to join us for office hours then too: https://cloudposse.com/office-hours (free)

and checkout our past sessions: https://podcast.cloudposse.com

Sweet thanks 🤘🏻

Hey everyone, give a warm welcome to our newest members!
- @marcinw
- @burnzy

Good to have you here =)

Hey everyone, give a warm welcome to our newest members!
- @Oliver Slater - Piksel
- @Blake

Good to have you here =)

@Erik Osterman (Cloud Posse) I'm pulling them in. I got @Chase Ward here from Calm

He's a developer.. devops dude.. but recently he's been hot in data, data pipelines, data engineering. Would Looooooooooove to see some discussions popup around devops + data engineering... Airflow at scale? (shit, I dunno all the hot tools nowadays)

Greetings homies!! Excited to be in a community of like-minded people! 🌩️

welcome @Chase Ward!

We have some experience with Airflow on Kubenetes, but don't think we can say "at scale" yet. Would definitely like to hear from others doing more with that.

maybe we should have a #bigdata channel

small is still a scale

airflow 2.0 (due in around 1 or 2 quarters) and airflow kNative executor should allow much greater scale workflows than currently. Airflow k8s executor and pod operator gets awkward over around 1,000 tasks/dag and 1,000 tasks/hour in my experience.

@Eamon Keane, Are you running airflow deployments in a pipeline to deploy DAG updates to kubernetes or are you cheating and just letting devs skip version control and work right out of shared storage for their DAGs?

(just curious)

And I wonder if spark 3 will ever be released (along the lines of long awaited releases...)

@Zachary Loeber we only use k8s pod operator and bake dags in image so every dag change produces dockerfile and helm chart. Dev can fully test locally independent of airflow...keeps things sane but obviously misses out on built-in airflow operators.

Happen to be running any spark jobs via airflow as well? I do a helm based deployment that re-kicks off their DAG creation (my immature favorite airflow insider term is fillin' up the dagbag!) using pre-created shared storage and other pipeline witchcraft. They are using the kubernetes scheduler to kick off spark operator jobs (which are just a fancy bash-operator using spark-submit from all I can tell) that use some pre-deployed secrets to allow for backend storage connections to the spark-history server. It seems bonkers to me considering I do the same kind of deployments for another team without airflow at all using native kubernetes cronjobs and some python....

don't use spark, no. We're using airflow as a fancy k8s cronjob orchestrator. It is quite useful to have the UI for visibility and the execution variables like next_ds available for input to the dags and easy retries/backfills and dependency management. Everyone starts off thinking they can do it themselves and regrets it... that's how airflow was started in the first place!

do you run it in its own cluster and deploy to other clusters then?

Hey everyone, give a warm welcome to our newest members!
- @Chase Ward
- @Hussein Khazaal
- @ballew
- @Robert

Good to have you here =)

Hey everyone, give a warm welcome to our newest members!
- @Bradford Toney
- @Bananahands
- @sathish krishnan

Good to have you here =)

Hey everyone, give a warm welcome to our newest members!
- @Mohammad

Good to have you here =)

Hey everyone, give a warm welcome to our newest members!
- @Oliver Fasterling
- @Omri Siri
- @Nitzan Yemal

Good to have you here =)

Hello, does anyone knows how to do this kind of slide deck : https://hashicorp.github.io/field-workshops-terraform/slides/aws/terraform-oss/index.html#1 ?

Hey everyone, give a warm welcome to our newest members!
- @Lenucksi

Good to have you here =)

@Alexandre Yes, well something similar at least. Here is a hugo based reveal.js themed slide deck I did for a generic devops 101 thing I did for work a bit ago: https://github.com/zloeber/deck.loeber.live

The rendered site helps I suppose: https://deck.loeber.live/#/home

fancy!

It was a lot of effort to avoid having to use powerpoint 'eh?

Still waiting on a Powerpoint provider for Terraform

Hey everyone, give a warm welcome to our newest members!
- @Jim Park
- @Jillian Rowe
- @Pradeep Kumar Ashokan
- @Pú
- @Yunier
- @Yonatan Koren

Good to have you here =)

Hey everyone, give a warm welcome to our newest members!
- @Igor Bronovskyi
- @Graeme Gillies
- @Miracle Max
- @gui
- @creature
- @leonyi

Good to have you here =)

Hey everyone, give a warm welcome to our newest members!
- @Ryan Bonner
- @Naveen Dhondapati
- @leo.hu
- @Jeff Levin
- @bradym
- @Lennart Wilke
- @Chase
- @Chris OBrien

Good to have you here =)

Happy to be here! 🙂

Looking for simple condition to set in EC2 instance template with ALB, that will hold the 2nd (HA instance being deployed) so I can get the first up with some manual config running then remove condition to lauch the instanceB

Hey everyone, give a warm welcome to our newest members!
- @Sri
- @Raymond Liu
- @Alex Tamoykin
- @Julian Gindi
- @JJ Ferman
- @Sebastian Stadil

Good to have you here =)