#kops - July 2019

kopsArchived
39 messages

Discussions related to kops for kubernetes
Archive: https://archive.sweetops.com/kops/

Jan
Janover 7 years ago
We are about to explore upgrading kops and k8s to 1.12.x from 1.11.x
Jan
Janover 7 years ago
I have done the upgrades many times with Kops, not within the scope of geodesic
Jan
Janover 7 years ago
Anyone else done so yet?
Jan
Janover 7 years ago
it does sound a lot safer to spin up a new cluster
Jan
Janover 7 years ago
yup
Jan
Janover 7 years ago
100%
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
Long thread below that
Jan
Janover 7 years ago
thanks, I went over that
Jan
Janover 7 years ago
honestly at this point im thinking I will build the capability to do full cluster backup and restore
Jan
Janover 7 years ago
try the update path as described in kops
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago(edited)
probably better to rebuild if you can
Jan
Janover 7 years ago
if it goes tits up then re-roll the version we have
Jan
Janover 7 years ago
and restore
Jan
Janover 7 years ago
since the migration of data from one cluster to another requires downtime as is
Jan
Janover 7 years ago
feels like a better route
Jan
Janover 7 years ago
will need some planning and testing as we several prod workloads across 3 regions
Jan
Janover 7 years ago
will be fun though 😄
Fernanda Martins
Fernanda Martinsover 7 years ago
Hello All,
I was reading Kubernetes Security Best Practices and it mentions the practice to use private topology with private VPC. Does anyone here uses a public website of sorts on top of Kops private topology?
How is that working out?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
@Fernanda Martins exactly, so best practice is to run all the masters and nodes on a private topology, but then use an Ingress to expose a service
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
so a service will sit on a private "cluster ip", and the (public) ingress will send traffic to that service.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
technically, an ingress can be public or private. in your case, you'd want a public ingress.
Fernanda Martins
Fernanda Martinsover 7 years ago
That what essentially KOPS does because I see some private subnets and public ones tied with Load Balancer...
Fernanda Martins
Fernanda Martinsover 7 years ago
But I wonder if the public ones are configured in the best way...
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
There's never a single best way; I guess it depends on the organization. For our use-case, we stick with the kops strategy.
Fernanda Martins
Fernanda Martinsover 7 years ago
I also...looking at KOPS configured with Public DNS but... I also wonder if thats good given that it creates records in etcd.... do you anything about this?
Sergey
Sergeyover 7 years ago(edited)
Hi everyone!
I have the new question again 🙂
I am trying to set up k8s cluster using kops. I know that official documentation says that I should provide the user with Iam permissions

AmazonEC2FullAccess
AmazonRoute53FullAccess
AmazonS3FullAccess
IAMFullAccess
AmazonVPCFullAccess

But these permissions include FullAccess. This is very insecure.
Do you have any the minimal rule sets that exclude FullAccess?
Sergey
Sergeyover 7 years ago(edited)
I would like to know how do you, guys, make this setup
Because, some time, we need to set up k8s cluster into the customer account and customer's admins are afraid 😐️ the FullAccess policies
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
You're not giving this level of access to kops
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
you are giving this level of access to the person or process responsible for provisioning kops
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago(edited)
the user will need CRUD for EC2, ELBs, EBS, EIP, S3, VPC, and at that point, they are basically admins 😃
Sergey
Sergeyover 7 years ago
Thank you for explanation. I assumed that. Now that is not a problem.
Sergey
Sergeyover 7 years ago
Guys, if I made the manual changes in the terraform.tf file which I exported from kops, will kops upgrade procedure work properly? Or will this procedure discard my changes and apply a configuration that stored in kops?
E.g. I use one NAT gw for 3 AZ (other two NAT gws I have removed from terraform.tf manually)

Will revert the kops upgrade procedure two nat gws back? Right?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
I don't have enough context
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
the terraform.tf file? ...that could be anything
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
😃
Sergey
Sergeyover 7 years ago
Oh, sorry, I ment kubernetes.tf :)
Sergey
Sergeyover 7 years ago
Just have tested upgrading Works well