#kubecost

kubecost

Archived
0302

Kubernetes resource and cost management
Archive: https://archive.sweetops.com/kubecost/

erik
erikover 4 years ago
archived the channel
Jonathan Tobe
Jonathan Tobeabout 6 years ago
@Jonathan Tobe has joined the channel
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 6 years ago
yea! nicely done 😃
Webb
Webbover 6 years ago(edited)
Thanks for sharing, @Rob Faraj! It’s actually on the front page of Hacker News at the moment! 🙂 https://news.ycombinator.com/
Rob Faraj
Rob Farajover 6 years ago
The AWS team wrote a great article on tracking costs in multi-tenant Amazon EKS clusters using Kubecost https://aws.amazon.com/blogs/containers/how-to-track-costs-in-multi-tenant-amazon-eks-clusters-using-kubecost/
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 6 years ago
Adding @U010XGY9B46 bot
Webb
Webbover 6 years ago
Ohh, thanks for the introduction, @Erik Osterman (Cloud Posse)!! @Blaise Pabon, let’s talk 🙂
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 6 years ago
@Webb need any community evangelists? ☝️ 😃
Blaise Pabon
Blaise Pabonover 6 years ago
FWIW, I have had an interest in k8s resource consumption and billing for about a year now. I was following the https://github.com/project-koku project for a while.
Blaise Pabon
Blaise Pabonover 6 years ago
@Erik Osterman (Cloud Posse) suggested that I join this channel after I made a comment along these lines:
My employer is cutting back on open source initiatives. I am looking to join a team of people developing a disruptive technology with a global scope and a demonstrable commitment to continuous improvement.

I'm coming out of an established log aggregation vendor, so I could be immediately useful to observability vendors.

I can do anything I need to in English, Spanish and French.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 6 years ago
Thanks @Webb
Webb
Webbover 6 years ago
Hi @Igor Rodionov that log has indeed been moved to debug verbosity about a month ago. Our latest build should no longer contain. Anything else we can help with?
Igor Rodionov
Igor Rodionovover 6 years ago
@Ajay Tripathy
We are running kubecost version 1.46.6
Because of k8s autoscaling we see a lot of log messages in cost-model container.
Like that
I0228 23:14:25.979517       1 costmodel.go:623] Node "10.102.44.77:10255" has been deleted from Kubernetes. Query historical data to get it.

How can we reduce logging noise?
If update kubecost would solve the problem?
Is there any env var that change logging verbosity ?
Igor Rodionov
Igor Rodionovover 6 years ago
Hello
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 6 years ago
@UUB28NLDS help keep tabs! 😉
Webb
Webbover 6 years ago
Sweet, let me know if we can help!
Jan
Janover 6 years ago
Busy looking to implement kubecost at a new company using gke
Jan
Janover 6 years ago
Awesomeness
Jan
Janover 6 years ago
@Webb have yiu got some other slack space or something? Seems pretty quiet in here
Webb
Webbabout 7 years ago
Glad to hear! Let me know if you have any other questions or issues.
AG
AGabout 7 years ago
Hi @Webb it is resolved now. It was the problem with PVC where its not updating the volume size. worked when re-increased the size.
Webb
Webbabout 7 years ago
Hi @AG this is a new one for me. Is this for the prometheus-server volume itself or something else?
AG
AGabout 7 years ago
err="opening storage failed: zero-pad torn page: write /data/wal/00001581: no space left on device"
AG
AGabout 7 years ago
@here after increasing pvc for prometheus-server and restarting the pod still seeing the below error
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)about 7 years ago(edited)
see my answer in #kubernetes
AG
AGabout 7 years ago
how to encrypt passwords in helm values.yaml, any good documents is appreciated. Thanks
AG
AGabout 7 years ago
sure. Recently I started working on it.. will definitely post here if any question. Thanks again.
Webb
Webbabout 7 years ago
Of course! Let me know if we can help anywhere else
AG
AGabout 7 years ago
Thank you @Webb
Webb
Webbabout 7 years ago
Yep, it should if port is correct. Our front end (settings) will tell you if those metrics are not scraped successfully.
AG
AGabout 7 years ago
@Webb will it work if node-exporter running in different namespace?
Webb
Webbabout 7 years ago
You can also disable our node exporter
Webb
Webbabout 7 years ago
If it’s running on the default nodePort it should just get picked up by or Prometheus
AG
AGabout 7 years ago
@AG if the prometheus-node-exporter already running in the cluster, how do I use it for kubecost
Jan
Janabout 7 years ago
very nice @Webb
Jan
Janabout 7 years ago
much appreciated!
Jan
Janabout 7 years ago
cheers mate
Jan
Janabout 7 years ago
ah I see
Jeremy G (Cloud Posse)
Jeremy G (Cloud Posse)about 7 years ago
The slack notification is a feature of AlertManager. If you are using your own Prometheus then you are also using your own AlertManager and have to configure Slack there.
Jan
Janabout 7 years ago
any idea on the slack notification where im going wrong?
Jan
Janabout 7 years ago
which I should probably just do
Jeremy G (Cloud Posse)
Jeremy G (Cloud Posse)about 7 years ago(edited)
@Jan As I explained before, the setting you need is global.grafana.domainName but you are only setting grafana.domainName
Jan
Janabout 7 years ago
that said I have not yet pulled the chart apart
Jan
Janabout 7 years ago
I just dont seem to be able to preset those parameters (slack and grafana address)
Jan
Janabout 7 years ago
so everything else is working fine
Webb
Webbabout 7 years ago
Thanks for sharing! You’re meaning to be using a ServiceMonitor correct? That looks like the only part I haven’t tested recently. @Jeremy G actually has a similar config I believe.
Jan
Janabout 7 years ago
works if i set it via the kubecost site after
Jan
Janabout 7 years ago
well it doesn't get set