#announcements - August 2018

429 messages

This channel is for workspace-wide communication and announcements. All members are in this channel.
Archive: https://archive.sweetops.com

August 2018
pmuller
pmullerover 8 years ago
oh, I did not know about tf overrides, that's great, thank you @loren 🙂
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
(i’m looking into using them right now to help us solve our coldstart problem in a nicer way)
pmuller
pmullerover 8 years ago
you want to use overrides to disable the s3 remote state temporarily ?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
yea, exactly!
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
our hack right now is to use sed
pmuller
pmullerover 8 years ago
yes i read that
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
so instead echo 'terraform { }' > overrides.tf
pmuller
pmullerover 8 years ago
i have the same issue on my side, so overrides are promising to solve a few ugly stuff (i really want to AVOID writing another tf wrapper... ;))
pmuller
pmullerover 8 years ago
in the meantime, i did another attempt to solve my issue: using https to access codecommit ; now i need to prefix some terraform and git commands with aws-vault, which is not that nice... but it works well
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago(edited)
(or aws-vault exec ... -- bash)
pmuller
pmullerover 8 years ago
hehe yeah
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
and just operate in a session
pmuller
pmullerover 8 years ago
i discovered aws-vault a few weeks ago, thanks to you guys
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
🎉
pmuller
pmullerover 8 years ago
before i used a dumb python script i wrote to do the same
pmuller
pmullerover 8 years ago
but with much less features 😛
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
yea, we did that too in the beginning
erik
erikover 8 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
do you use the aws-vault login action? love that!
pmuller
pmullerover 8 years ago
https://github.com/pmuller/awsudo maybe i should archive this too now 😛
pmuller
pmullerover 8 years ago
yep, love it too :))
pmuller
pmullerover 8 years ago
and rotate !
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
yea, I should use rotate. haven’t yet.
pmuller
pmullerover 8 years ago
the only thing i don't like is that aws-vault rotate doesn't handle MFA yet, and i don't like the idea of allowing key rotation without MFA
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
yea, it’s more strict
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
though i think we ended up allowing self-service key changes because developers would loose their IAM keys
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
…so they can login to the console and generate a new key pair
pmuller
pmullerover 8 years ago
guess it depends on your constraints
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
(but still require MFA to use keys)
pmuller
pmullerover 8 years ago
so you only allow MFA device management when authenticated with the MFA ?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
But I am definitely open to feedback
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
we wanted to allow new users to be able to setup their own MFA device without admin assistance
pmuller
pmullerover 8 years ago
so you allow MFA management without MFA but require it to deactivate it
pmuller
pmullerover 8 years ago
i have a similar policy in place
pmuller
pmullerover 8 years ago
but i do not like it
pmuller
pmullerover 8 years ago
but i do not require MFA to deactive MFA...yet
pmuller
pmullerover 8 years ago
it means that a leaked API key or user password is enough to create a new MFA device, then use the new one to access all roles of the compromised user
erik
erikover 8 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
Yea, looking at this again, seems like we should require MFA for that
pmuller
pmullerover 8 years ago
yep !
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
unsure about "iam:ResyncMFADevice",
pmuller
pmullerover 8 years ago
resync = allowing the user to pass 2 consecutive tokens to AWS ?
pmuller
pmullerover 8 years ago
not sure I get how this could be dangerous
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
ok
pmuller
pmullerover 8 years ago
when digging about my terraform modules / codecommit issue, i stumbled upon some "Terrafile" projects ; any thoughts about these ?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
I’m not familiar with terrafile
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
Looks very interesting. Ultimately, what I want though is something more like this: https://github.com/dependabot/feedback/issues/118
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
To help us manage and keep deps up to date.
pmuller
pmullerover 8 years ago
oh that's a nice service !
pmuller
pmullerover 8 years ago
i'd like the same for in house code
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
they support many languages and private repos
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
erik
erikover 8 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
we’re currently using them for Docker and Submodules.
pmuller
pmullerover 8 years ago
in my current company, all repositories are in VPCs, and I cannot imagine opening this up to the internet (very sensitive code)
pmuller
pmullerover 8 years ago
but for other businesses, i'll definitely try this
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
heh, yea - understandable
i5okie
i5okieover 8 years ago
hm can’t install gomplate on amazon linux
i5okie
i5okieover 8 years ago
nvm
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
We distribute a docker image with all the binaries we use
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
the install/ folder has the Makefile target for installation
stephen
stephenover 8 years ago
👋 just saying hi, been lurking in the background for a few days reading over the code everyone has been publishing, they have been incredibly useful resources
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago
hi @stephen, welcome
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 8 years ago
Thanks @stephen ! It’s really encouraging to hear that. :-)
krogebry
krogebryover 8 years ago
I'm helping a friend with a ... gig of sorts. He's working on material that would help teach people how to interview better.
krogebry
krogebryover 8 years ago
Does anyone here have any thoughts on how to promote that idea?
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago
from tech point of view, maybe a mobile app or mobile site or PWA (Progressive Web App) so people would use it on their phones
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago
with server-side updates for new materials
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago
@krogebry or you are asking about marketing?
krogebry
krogebryover 8 years ago
Maybe, I'm not exactly sure on this one, it's a totally new field.
krogebry
krogebryover 8 years ago
I think interviewing people for technical positions is something we don't do well in this business in general, specifically in the arena of the enterprise
krogebry
krogebryover 8 years ago
Obviously @Erik Osterman (Cloud Posse) is a pro 😉
krogebry
krogebryover 8 years ago
So, between better interviews that are more able to create productive outcomes ( hiring people that are better fits ) and my theory that influence is the new currency of IT
krogebry
krogebryover 8 years ago
I'm trying to figure out how to get my buddy into a position where we can ...something something... create better interviews.
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago
for me, it would be nice to have a mobile app (or mobile website) with learning materials, and then a test exam, and a real exam/test
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago
also, the question of why? would be more important and useful than what? and how? (as we see in many interview materials)
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago
e.g.
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago
(off the top of my head)
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago
why would you use Terraform to provision cloud resources if you can do everything manually (and even faster) (stupid question 🙂
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago
why and in what cases would you use EC2 instances to deploy a database instead of utilizing managed services like RDS or Aurora
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 8 years ago(edited)
why would you use Kubernetes instead of ECS (or otherwise)
krogebry
krogebryover 8 years ago
yeah, Love those questions
krogebry
krogebryover 8 years ago
Simon Sinek is a big fan of starting with why
krogebry
krogebryover 8 years ago
So according to my friend, Christian, the biggest indicator of success in any role ends up being more around the idea of attitude
krogebry
krogebryover 8 years ago
One of the questions he asked in interviews ( for microsoft ) was: how do you make friend
krogebry
krogebryover 8 years ago
*friends
krogebry
krogebryover 8 years ago
Apparenlty that had more to do with success than anything technial
smoll
smollabout 8 years ago
i stumbled on https://github.com/cloudposse/bastion earlier today and it looks really nice, but i'm wondering if the primary use case is to connect to stuff in a preexisting k8s cluster. what about if the primary use case is terraforming/modifying the cluster itself? in that case, wouldn't it be better if the bastion lived outside of the cluster entirely?
jengstro
jengstroabout 8 years ago
hello all
jengstro
jengstroabout 8 years ago
does anyone happen to know why I am getting the following odd error when trying to stand up an RDS cluster with terraform-aws-rds-cluster?
jengstro
jengstroabout 8 years ago
jengstro
jengstroabout 8 years ago
thx in advance
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
hi @jengstro
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
what db are you trying to deploy, MySQL or Postgres?
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
I think you are mixing some parameters from both
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago

DBParameterGroupFamily

The DB cluster parameter group family name. A DB cluster parameter group can be associated with one and only one DB cluster parameter group family, and can be applied only to a DB cluster running a database engine and engine version compatible with that DB cluster parameter group family.

Aurora MySQL
Example: aurora5.6, aurora-mysql5.7

Aurora PostgreSQL
Example: aurora-postgresql9.6
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
oscar5.6 is for MySQL
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago(edited)
if you use engine = "aurora-postgresql", then cluster_family should be aurora-postgresql9.6
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
if you use engine = "aurora", then cluster_family should be aurora-mysql5.7
jengstro
jengstroabout 8 years ago
that did the trick @Andriy Knysh (Cloud Posse) thank you
jengstro
jengstroabout 8 years ago
@Andriy Knysh (Cloud Posse) Even though it appears that db.t2.medium appears to support aurora-postgresql9.6... I get an error...
jengstro
jengstroabout 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
1 sec
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
db.r4.large is the smallest instance type supported by Aurora Postgres
jengstro
jengstroabout 8 years ago
ahh ok
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
db.r4.large is expensive for anything but prod (e.g. dev or staging)
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
MySQL is better with pricing
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Ya pretty pricey
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
We have had luck deploying Postgres in Kubernetes for disposable environments like staging and dev
jengstro
jengstroabout 8 years ago
thanks guys
i5okie
i5okieabout 8 years ago
hey guys, slightly off-topic perhaps, question…
i5okie
i5okieabout 8 years ago
Have you guys ever use an external Kibana with an AWS ElasticSearch domain?
i5okie
i5okieabout 8 years ago
I’ve just supposedly connected a Kibana on ec2 instance to ES domain, but kibana’s blank
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
We recently have been using that! 😃
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago(edited)
Did you know that AWS ElasticSearch ships with kibana
i5okie
i5okieabout 8 years ago
yeah but you can’t extend if plugins
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
aha
i5okie
i5okieabout 8 years ago
it with*
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
so we also have been using the helm chart for kibana on kubernetes
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
we pretty much only do containerized stuff these days
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
@Andriy Knysh (Cloud Posse) might have some insights 😃
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
yea, we deployed Kibana on K8s and connected it to AWS Elasticsearch
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
we also used the Kibana that comes with Elasticsearch
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
@i5okie did you deploy the ES cluster into AWS public domain or into your VPC?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
but @i5okie brings up a good point about the plugins. we haven't yet gone deep on ES.
i5okie
i5okieabout 8 years ago
VPC
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
ok, good point about plugins, we need to look at it
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
about VPC… Did you create the correct Security Groups to connect from the EC2 instance to the cluster?
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
and also, did you use any IAM policies for ES?
i5okie
i5okieabout 8 years ago
this is when I start kibana in cli with -e and point to ES domain
i5okie
i5okieabout 8 years ago
right now my security policy on ES is just opened up completely. and security group’s open for the EC2 instances.
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
looks good
i5okie
i5okieabout 8 years ago
except every page in Kibana is blank, besides the menu
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
what do you mean by empty Kibana?
i5okie
i5okieabout 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
nothing on the right side?
i5okie
i5okieabout 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
if you click on Dev Tools
i5okie
i5okieabout 8 years ago
nope, only shows if i look at status. everything else is empty. including dev tools
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
hmm, never seen that
i5okie
i5okieabout 8 years ago
ikr
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
maybe broken Kibana?
i5okie
i5okieabout 8 years ago
hmm
i5okie
i5okieabout 8 years ago
could be. i installed it by downloading the rpm. so i can match the version
i5okie
i5okieabout 8 years ago
maybe i need to get the -oss flavor one?
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
not sure. we did install it from https://github.com/cloudposse/helmfiles/blob/master/helmfile.d/0630.kibana.yaml (it uses the Kibana chart)
i5okie
i5okieabout 8 years ago
ah docker.
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
i5okie
i5okieabout 8 years ago
I’m still a docker n00b for the most part. nevermind kubernetes 😞
i5okie
i5okieabout 8 years ago
about to switch production app from heroku to elasticbeanstalk. and i’ve been getting a pretty clear message that ECS is probably the way to go instead..
i5okie
i5okieabout 8 years ago
so im going to have to do more learning
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
yea, that’s good
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
you can try diff versions from rpm
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
(it’s easy to break stuff with Kibana, even if server and client have diff versions, will be a lot of issues)
i5okie
i5okieabout 8 years ago
interesting. so you guys are using kibana 6.3.1… but AWS ES is on 6.2 there’s no version mismatch? like it doesn’t complain?
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
it did 🙂
i5okie
i5okieabout 8 years ago
hmm 🤫
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
we told it to use 6.0.0
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
for the client
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
KIBANA_IMAGE_TAG was set to 6.0.0
i5okie
i5okieabout 8 years ago
ah
i5okie
i5okieabout 8 years ago
ok i’ll try the docker route
i5okie
i5okieabout 8 years ago
thanks
i5okie
i5okieabout 8 years ago
while im here…
So I know what docker is, i’ve built docker images, ran them locally, made one for circleci.. bam.
What would be a good path to go from here? if you’re using Kubernetes, do you use aws EKS instead of ECS then?
i5okie
i5okieabout 8 years ago
at this point i just have the aws associate architect cert.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
I think it depends a little bit about your use-case, how many services, how many engineers, etc
i5okie
i5okieabout 8 years ago
me myself and i are the only devops engineers here. at least for now. lol
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
I think kubernetes is awesome for teams of 5+ hands on engineers who will share devops responsibilities, and where you have a lot of services to deploy.
i5okie
i5okieabout 8 years ago
ah gotcha
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago(edited)
But the kubernetes ecosystem moves so fast, that as a solo-engineer whose job is to maintain it, it will be a lot of work, as much as I hate to say it.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Kubernetes >> ECS. However, for simpler use-cases, it's still awesome.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
have you seen our modules for ECS?
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
I think the easiest way now is SSH to the EC2 instance and run Kibana in Docker, just to confirm everything is ok
i5okie
i5okieabout 8 years ago
so at what point does it make sense to go from elastic beanstalk which would manage about 16+ instances.. to ECS?
i5okie
i5okieabout 8 years ago
ah thats a good idea @Andriy Knysh (Cloud Posse)
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago(edited)
We had really bad experiences with beanstalk. Namely, lots of failed deploys due to dependencies failing (temporary 503s, or broken rpm repos, etc). I think if we did it again, and had beanstalk as a requirement (e.g. due to customer), we would use beanstalk+containers.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
but given the choice between beanstalk and ECS, ECS would definitely be my pick.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
containers solve so many problems about packaging dependencies, testing, and deployment
i5okie
i5okieabout 8 years ago
i’ve been looking at Segment’s Stack (terraform modules) pretty opinionated. but kind of cool. so im using your modules to sort of setup a good infrastructure with public/private subnets, EB.. etc. (someone before me ended up putting everything except DB to public subnets)
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
yea, no fun taking over that kind of environment.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
hopefully you can make some big inroads on how they architect things
erik
erikabout 8 years ago
added an integration to this channel: Google Calendar
Dan
Danabout 8 years ago
What's everyone doing these days to learn kubernetes and terraform?
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
hi @Dan
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago(edited)
practice in writing TF modules and helm charts and provisioning real infrastructure - it’s a slow process
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
(no books can substitute that :)
Luke
Lukeabout 8 years ago
Hi all, wondering if someone could point me in the right direction to get the bastion docker image working with the github integration, both running on docker on the same host.
Luke
Lukeabout 8 years ago
Does anyone have a working compose file I could look at?
sarkis
sarkisabout 8 years ago
@Dan shameless plug, check out docs.cloudposse.com.. tons of open source modules on GitHub as well that will take the initial work of getting kubernetes running a much easier task than it really is... Then as @Andriy Knysh (Cloud Posse) said, nothing can replace just doing things on the cluster - use kubectl until you are comfortable with it and then start automating it out of your workflow
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
as @sarkis pointed out, take a look at our docs https://docs.cloudposse.com/ and also our reference architectures https://docs.cloudposse.com/reference-architectures/
Dan
Danabout 8 years ago
Thank you! I have been looking through those modules and they look great. Just slowly learning and getting through it
sarkis
sarkisabout 8 years ago
I'll say from experience aha moment will take a couple weeks. Once you get there though - you will wonder where these modules were all your tech life 😎
sarkis
sarkisabout 8 years ago
Also please do contribute, ask here, or open issues as you go through if something is not clear...
sarkis
sarkisabout 8 years ago
@Luke how far along are you? If you share some context/dockerfiles/compose I could try and help.
Luke
Lukeabout 8 years ago
@sarkis - I’m having issues getting the bastion talking to the github api.

If you have any docket files I can scan over that would be a massive help
sarkis
sarkisabout 8 years ago
Hm, I have not done this myself before, however first thing I'd check is the networking outbound from the bastion docker container
i5okie
i5okieabout 8 years ago
back to docker kibana… im now getting this. just wondering have you seen this issue too?
i5okie
i5okieabout 8 years ago
rfaircloth
rfairclothabout 8 years ago
I found this place because of copyright-header
rfaircloth
rfairclothabout 8 years ago
Any maintainer hanging around?
Jamie Nelson (BitFlight)
Jamie Nelson (BitFlight)about 8 years ago
Hi @rfaircloth
Jamie Nelson (BitFlight)
Jamie Nelson (BitFlight)about 8 years ago
@sarkis and @Erik Osterman (Cloud Posse) should be online around now too normally
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
@i5okie regarding kibana, did you use any IAM access policy to control access to the cluster?
i5okie
i5okieabout 8 years ago
no
i5okie
i5okieabout 8 years ago
its setup with VPN, and access policy is *
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
what is your?
i5okie
i5okieabout 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago(edited)
also, another reason could be a time drift in Docker container, which prevents AWS request from being properly signed
i5okie
i5okieabout 8 years ago
right
i5okie
i5okieabout 8 years ago
right now im trying to figure out why docker isn’t exposing the kibana port.
i5okie
i5okieabout 8 years ago
i5okie
i5okieabout 8 years ago
kibana_1 | {“type”:“log”,“@timestamp”:“2018-08-08T16:28:00Z”,“tags”:[“listening”,“info”],“pid”:1,“message”:“Server running at http://0.0.0.0:5601"}
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
i5okie
i5okieabout 8 years ago
funny enough thats what im looking at right now
i5okie
i5okieabout 8 years ago
works
i5okie
i5okieabout 8 years ago
but back to the authorization issue
i5okie
i5okieabout 8 years ago
oh i lost the --oss flag dang it
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
@i5okie same issues with credentials or signature headers?
i5okie
i5okieabout 8 years ago
signature headers… the xpack thing
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
@smoll i personally did not test bastion, can take a look. Maybe @Erik Osterman (Cloud Posse) will help faster when he is online
smoll
smollabout 8 years ago(edited)
no worries @Andriy Knysh (Cloud Posse). the bastion error looks like it could be stemming from the fact that github-authorized-keys isn't able to manage users properly (due to the connection failure). i wonder if i'm missing a required field from https://github.com/cloudposse/github-authorized-keys in https://github.com/cloudposse/charts/blob/master/incubator/bastion/values.yaml#L11
i5okie
i5okieabout 8 years ago
Back to this.
Running Kibana from Docker.
Looks like it connected to ellastic search.
But the pages are all blank.
i5okie
i5okieabout 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Oh well @i5okie how do you find those empty Kibanas :)
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Can you try to delete all browser cache just in case, or use a different browser?
i5okie
i5okieabout 8 years ago
😢i dont know
i5okie
i5okieabout 8 years ago
wtf
i5okie
i5okieabout 8 years ago
it works in firefox
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Haha
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Browser cache
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
So you had it working before too
i5okie
i5okieabout 8 years ago
this is so odd
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Just did a nice exercise with Docker, which is good for you too :)
i5okie
i5okieabout 8 years ago
kibana from AWS ES, loads fine in chrome.
i5okie
i5okieabout 8 years ago
this is same version too
i5okie
i5okieabout 8 years ago
i see.
i5okie
i5okieabout 8 years ago
its the basic auth. thats the issue
i5okie
i5okieabout 8 years ago
this happens when i have basic auth on nginx. for troubleshooting i turned nginx off and piped all traffic to docker instead. so firefox didn’t have the basic auth, and chrome had it.
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Ok I see
i5okie
i5okieabout 8 years ago(edited)
ok for future reference: If someone sets up Kibana separate from ElasticSearch, proxied through NGINX, and gets a blank screen.
After basic authentication Kibana will load, but when requesting data from elasticsearch NGINX passes the basic auth headers which ES doesn’t like. The following nginx config flushes the auth header.
i5okie
i5okieabout 8 years ago
/etc/nginx/conf.d/kibana.conf
i5okie
i5okieabout 8 years ago(edited)
have to reset the auth header when passing to proxy
smoll
smollabout 8 years ago(edited)
so it looks like this error Connection to <http://github.com|github.com> failed https://github.com/cloudposse/github-authorized-keys/blob/111b4401d4597c6a97b7a5316bcd35e697ab07ff/api/github.go#L32 is getting raised no matter what the actual error is, for example even if i change the oauth token to "x" i get the exact same error
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Hey y’all - sorry, I am AWOL. Traveling today to Tulum, MX on vacation. Will be available intermittently. Looks like a lot has been discussed today! Will reply to all threads as soon as we get settled.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
If you're still waiting on a PR code review or some other issue, let me know!
Sebastian Nemeth
Sebastian Nemethabout 8 years ago
I have a stupid question, but what is the correct set up for using geodesic modules in CI/CD? Is the goal to have changes to infrastructure auto-deployed through promotion through CD pipelines, or is the cloudposse approach all about pushing things from CLI using the geodesic wrapper?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago(edited)
Our ultimate goal is to do exactly what you want: test and deploy the geodesic-based containers as part of cicd.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
The interactive cli was the easiest way to get started.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
I think it’s about a week worth of effort to implement. Basically, the way we look at it is this: infrastructure as code is the same as all other code. Therefore we should treat it the same. Package the infrastructure inside a geodesic container. Test that container. If successful, push image to repo. Deploy to target environment by running container and calling apply.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago(edited)
So what I don’t like about Atlantis is that it violates this paradigm. It does not treat infrastructure as code like all other code. It requires a new standalone CI/CD system (the Atlantis daemon) to work, which is different from how we deploy all other software. I am not ripping on Atlantis; I think it’s cool what it does. I just wish it was compatible with the containerized approach we take, which is how all other modern software is deployed.
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
this cold be useful for dev and staging environments (low cost) https://aws.amazon.com/blogs/aws/aurora-serverless-ga/ (no Postgres yet)
U
Unknown Userabout 8 years ago
There are no events this week
Dan
Danabout 8 years ago
So for terraform AWS ssm parameters store.... Do I use that module to store the ssm values that I want to store? Then use the data and resource piece of that into another terraform module I have to call those values?(sorry I'm still new to all this!) My goal is there I don't want my access and secret keys in plain text so I want to have another module that will call those values and then I can pass those values as access and secret keys in AWS...(videos would be nice if you can explain it)
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
hi @Dan
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
yes you can use https://github.com/cloudposse/terraform-aws-ssm-parameter-store to write secrets to SSM from one Terraform module and then read the secrets from another TF module
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
we also use https://github.com/segmentio/chamber to write and read secrets from SSM
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago(edited)
take a look at our reference architectures https://docs.cloudposse.com/reference-architectures/ - shows how we use Terraform/chamber/SSM together
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
here are a few possible scenarios:

1. Use terraform-aws-ssm-parameter-store to write secrets from one TF module, and use terraform-aws-ssm-parameter-store to read secrets from another TF module
2. Use terraform-aws-ssm-parameter-store to write secrets from a TF module, and then use chamber in a CI/CD pipeline to read secrets from SSM and populate ENV vars for the application beign deployed
3. Use chamber to write secrets to SSM, and then use chamber in a CI/CD pipeline to read secrets from SSM and populate ENV vars for the application beign deployed
Dan
Danabout 8 years ago
Thank you! I'll look into it tomorrow!
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
Finally they caught up with the latest version 6.3 of Kibana and ES client
U
Unknown Userabout 8 years ago
There is 1 event this week
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
@here join us for our first open “Townhall” meeting this wednesday. Get to know everyone, ask questions, debate strategies, anything goes…. it’s an open discussion and everyone is invited!
loren
lorenabout 8 years ago
timezone? also, that link opens a google calendar... is that shared somewhere or is it private?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
I can also invite you directly
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
timezone is PST.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
We selected 9am since it works well with GMT too
loren
lorenabout 8 years ago
ahh my bad, just had to switch to the gsuite account associated with this workspace, now i see the event! 😄
loren
lorenabout 8 years ago
nice integration
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
OGProgrammer
OGProgrammerabout 8 years ago
Been using the EB app and env TF repos y'all made. Love it.
OGProgrammer
OGProgrammerabout 8 years ago
TY!
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
@OGProgrammer thanks! Appreciate it 😃
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
welcome to community!
U
Unknown Userabout 8 years ago
loren
lorenabout 8 years ago
tamsky
tamskyabout 8 years ago
tamsky
tamskyabout 8 years ago
@loren this may be the GitOps article you mentioned in townhall?
https://queue.acm.org/detail.cfm?id=3237207
loren
lorenabout 8 years ago
yep 🙂
tamsky
tamskyabout 8 years ago
tamsky
tamskyabout 8 years ago
antonbabenko
antonbabenkoabout 8 years ago
yes
antonbabenko
antonbabenkoabout 8 years ago
antonbabenko
antonbabenkoabout 8 years ago
tamsky
tamskyabout 8 years ago
Thanks for arranging todays townhall @Erik Osterman (Cloud Posse), kudos!
loren
lorenabout 8 years ago
ditto, good stuff
antonbabenko
antonbabenkoabout 8 years ago
Good stuff! Great to e-meet some of you today 🙂
tamsky
tamskyabout 8 years ago
Regarding bitly/oauth2_proxy — I mentioned the "sidecar" authentication mode, which is the 401 redirect.
Here's someone else's writeup of how to use it wtih nginx. (My usage is very similar...)
- https://carlosbecker.com/posts/prometheus-authentication-with-oauth2_proxy/
antonbabenko
antonbabenkoabout 8 years ago
Can somebody remind me where is the self-hosted version of TF Registry? I remember I saw some repo before summer, but can’t remember now.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
oh, i recall seeing an anouncement for that
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
but thought it was for enterprise
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
antonbabenko
antonbabenkoabout 8 years ago
no-no. It is someone’s open initiative, so code was on github 100%
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
aha
antonbabenko
antonbabenkoabout 8 years ago
it was incomplete, but still better than starting from scratch probably…
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
antonbabenko
antonbabenkoabout 8 years ago
Thanks, yes!
antonbabenko
antonbabenkoabout 8 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
@antonbabenko what are you working on ?
antonbabenko
antonbabenkoabout 8 years ago
It is not for me 🙂
antonbabenko
antonbabenkoabout 8 years ago
I just want to see open-source version of everything… now this - terrahub.io 🙂
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago(edited)
oh wow, that's cool - terrahub
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
smart idea for SaaS
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Better explanation
antonbabenko
antonbabenkoabout 8 years ago
follow me on twitter - https://twitter.com/antonbabenko - I blog almost exclusively about Terraform 😉
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago

We have sailed 1500 miles from Spain to Greece and now back to the life on the land!
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
wow 😃 jealous!
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
We had a successful "Town Hall" meeting. Unfortunately, I forgot to click "record", but will do that next time.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
I will be posting some meeting notes later on today
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
For now, I've setup a poll to vote for the next meeting time (for September 5th)
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
https://doodle.com/poll/d8z7m9u8n2ddtmfp (thanks @antonbabenko for suggestion)
tarrall
tarrallabout 8 years ago
Howdy folks. n00b user here! 👋 We’re trying out the AWS “reference architecture” stuff (docs.cloudposse.com/reference-architectures/) and have some n00b questions.

First up… we’ve followed the cold-start process and now have root.example.com, prod.example.com etc repos, accounts stood up, k8s cluster up in prod. Which is cool, but the current Dockerfile is basically an intermingling of configuration and code, making updating it to track the “upstream” versions (e.g. <http://prod.cloudposse.co/Dockerfile|prod.cloudposse.co/Dockerfile`>) awkward. Are there plans to extract the configuration into a separate file in order to make the existing repo more usable longterm, or is this intended more as a “here’s an example of how you might glue this all together” repo rather than a tool you’d use directly?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
@tarrall you're a very advanced "n00b" if you got that far
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
congrats! 😃
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
let's move the discussion to #geodesic if you don't mind
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
i'll answer there
tarrall
tarrallabout 8 years ago
Well, actually much of this was set up when I got here 🙂 and yup moving
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
aha, you're at Flowtune 😃
tarrall
tarrallabout 8 years ago
👍️
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
cool
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Here's are the minutes from today's Town Hall meeting:
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
sarkis
sarkisabout 8 years ago
@mrwacky welcome 🤠
loren
lorenabout 8 years ago
oh, i missed the mention of pullrequestreminders, that is awesome, just added it to our workspace 🙂
Gonzalo Peci
Gonzalo Peciabout 8 years ago
Hello!
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
welcome @Gonzalo Peci
adamstrawson
adamstrawsonabout 8 years ago
Hi all, We're looking at implementing the Bastion container alongside github-authorized-keys, but despite following the docs to the letter, I keep getting the below error on github-authorized-keys when attempting to sync users, anyone experienced it before?


{"job":"syncUsers","level":"error","msg":"exit status 1","subsystem":"jobs","time":"2018-08-23T15:16:19Z"}
adduser: Specify only one name in this mode.

I've not defined either SYNC_USERS_GID or SYNC_USERS_GROUPS, so it should be defaulting to adduser {username} --disabled-password --force-badname --shell {shell}, which I can't see why it would be triggering the above error
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
@adamstrawson I will get back to you in a couple hours.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
@adamstrawson can you give me a little bit more context
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago(edited)
are you deploying on kubernetes, ECS or regular instances?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago

adduser: Specify only one name in this mode.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
yes, I've experienced similar problems before.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
So our default command template works with alpine linux (if I recall correctly)
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
adduser is unfortunately not standardized across linux distributions
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
this is why we allow the command template to be defined with an environment variable
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago(edited)
I presume you're not running the github-authorized-keys daemon inside of the bastion container (which is not advisable)
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
@Gonzalo Peci anything we can help you out with?
adamstrawson
adamstrawsonabout 8 years ago
Hi @Erik Osterman (Cloud Posse) Thanks for coming back to me.
This is on a regular instance (on Digital Ocean), running Ubuntu 16.04
adamstrawson
adamstrawsonabout 8 years ago
we're not tied to using Ubuntu though, so if it's better supported with Alpine or similar I don't mind going with that
adamstrawson
adamstrawsonabout 8 years ago
I just used Ubuntu out of habit for my test servers
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
that defines the template compatible for debian systems
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
(albeit a year or two old)
adamstrawson
adamstrawsonabout 8 years ago
Great, I'll have a play with that - Thanks
adamstrawson
adamstrawsonabout 8 years ago(edited)
@Erik Osterman (Cloud Posse) That did the trick, thanks. Next question i'm afraid, I'm struggling to see how you get the github-authorized-keys container and the bastion container to work together. They're both running and working independently, but the bastion container doesn't seem to want to do anything with the keys (eg. if I ssh to -p 1234, I get permission denied.) github-authorized-keys has synced the users and keys to the host machine (I can ssh fine to the host machine with a synced user), but via the bastion container it doesn't detect any keys. Can't see in the docs how the two work together
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Sure, let me explain (but gimme a few to get back to you)
adamstrawson
adamstrawsonabout 8 years ago
Thank you, no rush
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Are you familiar with the sidecar pattern?
adamstrawson
adamstrawsonabout 8 years ago
I am
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
cool
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
@adamstrawson I'm going to move this discussion to #security
Dave
Daveabout 8 years ago
hi there, any tips for getting https://github.com/cloudposse/bastion working on ECS (amazon linux)? I have both containers running (bastion, and github-authorized-keys) but I'm not really sure how one makes use of the other and the exact volume mounts I need
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
@Dave would love to work with you to figure that out. Haven’t yet tried to deploy it that way.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
I am about to head to bed, but maybe ping me tomorrow or open up a GitHub issue and we can have a discussion there
Dave
Daveabout 8 years ago
@Erik Osterman (Cloud Posse) ok thank you! will do
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Basically, you would want to deploy a task with two containers
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago(edited)
GitHub authorized keys would be a sidecar to the bastion
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Are you familiar with Kubernetes?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
I could show you an example there
Dave
Daveabout 8 years ago
I think I'm close
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Yes that’s the one
Dave
Daveabout 8 years ago
I'll open an issue if I can't figure it out by the end of the day (here in Melbourne, AU). I may open an issue anyway, to share my task definition
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Would love for you to share that task definition if you get it working
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
I think others would dig it
Dave
Daveabout 8 years ago
yeah no worries
Max Moon
Max Moonabout 8 years ago
Not sure if anyone else listens to this but generally some pretty good stuff on here:
https://kubernetespodcast.com/
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Thanks for sharing. Listened to an episode today in the car. Got a lot out of it.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
@Dave how did it go with the bastion on ECS?
Maarten van der Hoef
Maarten van der Hoefabout 8 years ago
Hey everyone, I've invited @Alex Somesan , he worked before with CoreOS on Tectonic, and will now work on the Kubernetes Provider at Hashicorp .. Welcome 🎉
Alex Somesan
Alex Somesanabout 8 years ago
Hi all!
Thanks for having me around. This channel feels familiar. As Maarten said, i was involved in writing the installer tool for Tectonic on a few different cloud providers and before that i spent a few years at AWS. I hope I can help out around here.
See you around!
Maarten van der Hoef
Maarten van der Hoefabout 8 years ago
And we both are two horrible Terraform User Group organizers in Berlin 🙂
Alex Somesan
Alex Somesanabout 8 years ago
The worst!
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
@Alex Somesan welcome!
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
I never got to use Tectonic, but heard great things about the distribution
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
We could certainly learn a lot from someone with your background! 😃
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago(edited)
So you’re now working with the terraform-kubernetes-provider?
Alex Somesan
Alex Somesanabout 8 years ago(edited)
I’m starting with Hashicorp beginning of September. Most likely that provider will be my first endeavor there.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Cool - we haven’t started using that provider yet for anything. Mostly use helm for everything now. But I would be open to learning about complementary use-cases where the provider would help us out.
antonbabenko
antonbabenkoabout 8 years ago
Hi @Alex Somesanand welcome.
erik
erikabout 8 years ago
Who will be #100?
U
Unknown Userabout 8 years ago
There are no events this week
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
since we have quite a few new memembers since last week, I wanted to reintroduce the "Town Hall" meeting we have going on here
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
basically, we hold a ~1 hour call via Zoom. it's an opportunity for everyone to get to know each other, share what their working on, ask questions, and help us steer the direction of what we're building
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 8 years ago
Vote for the next time that works for you. We may run multiple meetings so we can be as inclusive as possible.
Matthew
Matthewabout 8 years ago
Hello friends, I have a question regarding the rds_cluster_aurora_mysql terraform module - currently I have a security group with my IP as an ingress rule, then I utilize that security group using the module and specify the group within the "security_groups" parameter and when I try to connect from our IP it gives a connection refused. I can simply add the rule to the security group the module creates which is the exact same rule within the security group I attached to it and it'll work properly. Any ideas?
Matthew
Matthewabout 8 years ago
Also does anyone use Mesosphere DC/OS ?
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
hi @Matthew
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
regarding terraform-aws-rds-cluster
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
you said and it'll work properly. Did you test it or just think it will work? 🙂
Matthew
Matthewabout 8 years ago
If i add my ingress IP to the generated security group the module creates it'll work
Matthew
Matthewabout 8 years ago
But when i attach the security group with the same ingress IP rule in it to the generated security group the module creates it won't work
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
did you test If i add my ingress IP to the generated security group the module creates?
Matthew
Matthewabout 8 years ago
Yes
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
did you place the cluster instances into public or private subnets?
Matthew
Matthewabout 8 years ago
public
Matthew
Matthewabout 8 years ago
If the module would create a security group and allow me to specify some ingress rules that would solve my problem
Matthew
Matthewabout 8 years ago
But as far as i can see, It only lets you attach pre-made security groups
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
do you see the other security group (with your IP) in the list of ingress rules for the cluster security group (that the module created)?
Matthew
Matthewabout 8 years ago
Yes
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
can you show images of the two SGs with ingress rules?
Matthew
Matthewabout 8 years ago
I sent in private chat
Jeff
Jeffabout 8 years ago
Quick question about terraform-aws-rds-cluster outputs... How do I ask for the cluster endpoint?
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago
hi @Jeff
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)about 8 years ago(edited)
The endpoint and reader_endpoint are not in the outputs of the module.
https://www.terraform.io/docs/providers/aws/r/rds_cluster.html#attributes-reference

If you need them, you can open an issue, and we’ll add.

But you can provide a Route53 Zone Id, and the module will create subdomains (more friendly names) for both master and replicas.
https://github.com/cloudposse/terraform-aws-rds-cluster/blob/master/outputs.tf#L21

Using Route53 is better since if you use the URL in your app and then rebuild the cluster, you will not have to update the URL
(if you use endpoint and reader_endpoint, they will change after each rebuild).
Jeff
Jeffabout 8 years ago
ahh ok
Jeff
Jeffabout 8 years ago
do you have an example of that somewhere?
Jeremy G (Cloud Posse)
Jeremy G (Cloud Posse)about 8 years ago
Is there a recipe somewhere for setting up a service with WebSocket/WebRTC ingress under Kubernetes on AWS?