#kops

kops

Archived
0263

Discussions related to kops for kubernetes
Archive: https://archive.sweetops.com/kops/

erik
erikover 1 year ago
archived the channel
Balazs Varga
Balazs Vargaover 4 years ago
can I set this flag --kernel-memcg-notification in kubelet ?
Balazs Varga
Balazs Vargaabout 5 years ago
https://kops.sigs.k8s.io/instance_groups/#warmpool-aws-only is this for OD only or can we use with spot fleet ?
Balazs Varga
Balazs Vargaalmost 6 years ago
Hello. Can I somehow get the default containerd toml file? /etc/containerd/config-kops.toml is empty
bradym
bradymalmost 6 years ago
That's a great question, also interested in the answer. Don't have any insight myself, unfortunately.
btai
btaialmost 6 years ago
question for the audience here: curious what people are doing to pass their CIS benchmarks etc. for kops clusters. I see alot of info out there about how to run your cluster through a CIS benchmark test but less so what people are doing to fix them. I’ve wanted to avoid going down the route of packer/custom AMIs (as that’ll open up a can of other worms) but wondering if that’s the only real solution as I don’t see any easier/obvious solutions ones out there.
btai
btaialmost 6 years ago
hi @bradym us simpsons folks seem to like our kops (esp chief wiggums)
bradym
bradymalmost 6 years ago
✋️
btai
btaialmost 6 years ago
anyone here still using kops? 😅
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 6 years ago
Adding @U010XGY9B46 bot
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 6 years ago
@UUB28NLDS help keep tabs! 😉
loren
lorenalmost 7 years ago
no, sorry, not really into kubernetes...
Ola
Olaalmost 7 years ago
@loren have you deployed a cluster with kops within govcloud?
loren
lorenalmost 7 years ago
i have access.... don't use it too regularly
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)almost 7 years ago
@Ola
loren
lorenalmost 7 years ago
@loren has joined the channel
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)almost 7 years ago
@loren are you using govcloud?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 7 years ago
@Jeremy G ☝️
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 7 years ago
@Andriy Knysh (Cloud Posse) can you review?
Alex Siegman
Alex Siegmanabout 7 years ago
Kinda dead in here, but @Erik Osterman (Cloud Posse) and co, I've added feature gates to the kops template. hoping for a review. I didn't see any notes on contributing for docs, but happy to fix that up also: https://github.com/cloudposse/reference-architectures/pull/48
Sharanya
Sharanyaabout 7 years ago
Did anyone Come across NPM memory Issues ?
Sergey
Sergeyover 7 years ago
Just have tested upgrading Works well
Sergey
Sergeyover 7 years ago
Oh, sorry, I ment kubernetes.tf :)
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
😃
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
the terraform.tf file? ...that could be anything
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
I don't have enough context
Sergey
Sergeyover 7 years ago
Guys, if I made the manual changes in the terraform.tf file which I exported from kops, will kops upgrade procedure work properly? Or will this procedure discard my changes and apply a configuration that stored in kops?
E.g. I use one NAT gw for 3 AZ (other two NAT gws I have removed from terraform.tf manually)

Will revert the kops upgrade procedure two nat gws back? Right?
Sergey
Sergeyover 7 years ago
Thank you for explanation. I assumed that. Now that is not a problem.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago(edited)
the user will need CRUD for EC2, ELBs, EBS, EIP, S3, VPC, and at that point, they are basically admins 😃
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
you are giving this level of access to the person or process responsible for provisioning kops
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
You're not giving this level of access to kops
Sergey
Sergeyover 7 years ago(edited)
I would like to know how do you, guys, make this setup
Because, some time, we need to set up k8s cluster into the customer account and customer's admins are afraid 😐️ the FullAccess policies
Sergey
Sergeyover 7 years ago(edited)
Hi everyone!
I have the new question again 🙂
I am trying to set up k8s cluster using kops. I know that official documentation says that I should provide the user with Iam permissions

AmazonEC2FullAccess
AmazonRoute53FullAccess
AmazonS3FullAccess
IAMFullAccess
AmazonVPCFullAccess

But these permissions include FullAccess. This is very insecure.
Do you have any the minimal rule sets that exclude FullAccess?
Fernanda Martins
Fernanda Martinsover 7 years ago
I also...looking at KOPS configured with Public DNS but... I also wonder if thats good given that it creates records in etcd.... do you anything about this?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
There's never a single best way; I guess it depends on the organization. For our use-case, we stick with the kops strategy.
Fernanda Martins
Fernanda Martinsover 7 years ago
But I wonder if the public ones are configured in the best way...
Fernanda Martins
Fernanda Martinsover 7 years ago
That what essentially KOPS does because I see some private subnets and public ones tied with Load Balancer...
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
technically, an ingress can be public or private. in your case, you'd want a public ingress.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
so a service will sit on a private "cluster ip", and the (public) ingress will send traffic to that service.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
@Fernanda Martins exactly, so best practice is to run all the masters and nodes on a private topology, but then use an Ingress to expose a service
Fernanda Martins
Fernanda Martinsover 7 years ago
Hello All,
I was reading Kubernetes Security Best Practices and it mentions the practice to use private topology with private VPC. Does anyone here uses a public website of sorts on top of Kops private topology?
How is that working out?
Jan
Janover 7 years ago
will be fun though 😄
Jan
Janover 7 years ago
will need some planning and testing as we several prod workloads across 3 regions
Jan
Janover 7 years ago
feels like a better route
Jan
Janover 7 years ago
since the migration of data from one cluster to another requires downtime as is
Jan
Janover 7 years ago
and restore
Jan
Janover 7 years ago
if it goes tits up then re-roll the version we have
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago(edited)
probably better to rebuild if you can
Jan
Janover 7 years ago
try the update path as described in kops
Jan
Janover 7 years ago
honestly at this point im thinking I will build the capability to do full cluster backup and restore