#aws - July 2019

90 messages

:aws: Discussion related to Amazon Web Services (AWS)
Archive: https://archive.sweetops.com/aws/

vishnu.shukla
vishnu.shuklaover 7 years ago
arn:aws:iam::634880740321:user/ad.dt is not authorized to perform: kms:DescribeKey on resource: arn:aws:kms:us-east-1:634880740321:key/ac43ea17-741a-4347-ac04-88d42ffec899
vishnu.shukla
vishnu.shuklaover 7 years ago
anyone can help me to fix this error
vishnu.shukla
vishnu.shuklaover 7 years ago
user is trying to access the SQS and SNS and user has full access for SQS and SNS
Nikola Velkovski
Nikola Velkovskiover 7 years ago
@vishnu.shukla I think you should remove your account id
vishnu.shukla
vishnu.shuklaover 7 years ago
@Nikola Velkovski thanks but got fixed i just created a custom policy for KMS and attached to the user and it worked.
Maciek Strömich
Maciek Strömichover 7 years ago
@Nikola Velkovski (-:
Nikola Velkovski
Nikola Velkovskiover 7 years ago
¯\(ツ)/¯
Ruan Arcega
Ruan Arcegaover 7 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
Oh, I didn't realize that eksctl was a joint effort.
erik
erikover 7 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
I thought it was only by Weaveworks + community
vitaly.markov
vitaly.markovover 7 years ago
yeah, awesome tool for creating EKS cluster compared to AWS EKS Console (web)
Dan
Danover 7 years ago
Anyone create an ALB to point to a KOPS k8 cluster?
joshmyers
joshmyersover 7 years ago
heh, interesting read
Laxman
Laxmanover 7 years ago
Hi, I am setting up my qa env using terraform and after the ec2 is provisioned the instance is failing health check. Any suggestions on why this is happening. I am using the right port number for health check.
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 7 years ago
@Laxman health check from what? A load balancer or from outside?
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 7 years ago
check security groups in any case
Maciek Strömich
Maciek Strömichover 7 years ago(edited)

Template format error: Unresolved resource dependencies [] in the Resources block of the template

anyone has any ideas what to look for in cloudformation template?
Maciek Strömich
Maciek Strömichover 7 years ago
doesn’t matter. fat fingers putting !Ref without pointing it to a resource
Maciek Strömich
Maciek Strömichover 7 years ago
How do you deal with multiple services running on ecs where everyone of them is configured with awsvpc networking?
Maciek Strömich
Maciek Strömichover 7 years ago
deal in terms of placing services on instances which e.g. have enough available NICs and doing autoscaling
Maciek Strömich
Maciek Strömichover 7 years ago
do you spread applications across multiple clusters and generally don’t care about this issue or do you have a fancy way of having a single ecs cluster with multiple services up and running?
Maarten van der Hoef
Maarten van der Hoefover 7 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
Great link
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
(Via previous link)
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
dalekurt
dalekurtover 7 years ago
Did anyone catch today’s keynote at AWS Summit in NYC?
dalekurt
dalekurtover 7 years ago
Any thoughts on AWS CDK for IaC?
Alex Siegman
Alex Siegmanover 7 years ago
This just went GA today: https://aws.amazon.com/cdk/
Alex Siegman
Alex Siegmanover 7 years ago
Aiming at Terraform it seems.
Hugo Lesta
Hugo Lestaover 7 years ago
Hello there someone has some experience using app mesh with k8s making routing im different aws accounts? I have the idea to connect a eks pod app with another eks pod app in another account
Hugo Lesta
Hugo Lestaover 7 years ago
The request should be do in aws backbone without go out to internet
dalekurt
dalekurtover 7 years ago(edited)
@Hugo Lesta You can look at using VPC peering.
Hugo Lesta
Hugo Lestaover 7 years ago
Is It works with app mesh? Aws support told me that is not possible share app mesh service or be used with cross account role
Hugo Lesta
Hugo Lestaover 7 years ago
Now I’m thinking that I should use cloud map to route internally in different accounts using vpc link
Hugo Lesta
Hugo Lestaover 7 years ago(edited)
The current architecture accounts is

The inbound traffic enters in an account called shared services and this traffic is routed to other accounts but for example, when account A with eks app send traffic to eks in account B , it should be sent using aws backbone instead internet
David
Davidover 7 years ago
is there a way to map port 443 on the LB to port 80 on the web server if so where do I make that modification?
Trent Scholl
Trent Schollover 7 years ago
Check out your target group configuration
Dave Yu
Dave Yuover 7 years ago
is using an Aurora Serverless DB cluster with a Heroku app not possible because of this limitation?
You can’t give an Aurora Serverless DB cluster a public IP address. You can access an Aurora Serverless DB cluster only from within a virtual private cloud (VPC) based on the Amazon VPC service.
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
that would appear to be the case. that said, you can deploy a connection proxy
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
@Dave Yu actually you should also be able to create an NLB with a target group to an IP
Dave Yu
Dave Yuover 7 years ago
an internet-facing NLB in a public subnet with a target group of Aurora Serverless endpoint IP addresses worked. thanks @Erik Osterman (Cloud Posse)!
PePe Amengual
PePe Amengualover 7 years ago
ALB you mean
PePe Amengual
PePe Amengualover 7 years ago
?
Dave Yu
Dave Yuover 7 years ago
nope, network load balancer
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
@Dave Yu that's awesome! glad there's an easy/reliable/scalable workaround
Maxim Tishchenko
Maxim Tishchenkoover 7 years ago(edited)
hey everyone, I have AutomatedSnapshotFailure alarm for my elasticsearch
but i don have any log, any error in cluster (it it green)
does anyone know whot could be a reason of AutomatedSnapshotFailure ?
AutomatedSnapshotFailure = Insufficient data
Maciek Strömich
Maciek Strömichover 7 years ago(edited)
hey, is anyone using localstack’s cloudformation mocks in their local pipelines?
chrism
chrismover 7 years ago
EKS is ... hmm
Decided to pop an EKS cluster up via rancher... also hmm but with extra (no ones tested this)

Are there any good TF, secure eks with calico network isolation and NLB (my god does EKS feel like its optimized for AWS's wallet)
chrism
chrismover 7 years ago
https://eksctl.io/ seems quite nice
chrism
chrismover 7 years ago
in the world of "lets all make a new tool for every job" 😄
chrism
chrismover 7 years ago
Interesting tool; no userdata for the amis though like tf
chrism
chrismover 7 years ago
The spot configs nice though
chrism
chrismover 7 years ago
It's impressive how they made cloudformation sooooooooo god damn slow
Maciek Strömich
Maciek Strömichover 7 years ago
don’t tell me about it
chrism
chrismover 7 years ago
Not being from the parallel universe the created EKS; assuming node groups are dumpable; without manually intervening via the UI like its 1999, is there a way to make sure nodes from the ASG are registered with the ILB
All a chap wants is (private net) ILB > (K8 Workers / nginx ingress)
chrism
chrismover 7 years ago(edited)
I tried the k8 ALB module; interesting but who wants to pay per ingress 😄
chrism
chrismover 7 years ago
if i lean back just hard enough I can see that terraform does what I want
chrism
chrismover 7 years ago
in that it unglues the extra cloud formation so I can do stuff that wont evaporate 🙄
chrism
chrismover 7 years ago(edited)
The aws eks providers (<https://github.com/terraform-aws-modules/terraform-aws-eks>) pretty nasty; luckily the cloudposse splits it out as I like. Hate nested objects as params in modules (looking at you aws-eks), terraforms dog rough when it comes to isolating things. its nice to have a flat hierarchy of mods 😄
Sharanya
Sharanyaover 7 years ago
looking for a way - when I have a s3 new file upload, I need Jenkins to trigger a new job --- CAN anyone help me out ?
mmarseglia
mmarsegliaover 7 years ago
is there a decent tool to remove all resources within an AWS account?
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
there are a few of them out there
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 7 years ago
mmarseglia
mmarsegliaover 7 years ago
ooh nuke
Erik Osterman (Cloud Posse)
Erik Osterman (Cloud Posse)over 7 years ago
mmarseglia
mmarsegliaover 7 years ago
thank you
mmarseglia
mmarsegliaover 7 years ago
there are quite a few out there.. 🙂
Andriy Knysh (Cloud Posse)
Andriy Knysh (Cloud Posse)over 7 years ago
three that are maintained
chrism
chrismover 7 years ago
one thing azure does better than aws is separate the machine from the data; I can resize a vm in azure with a slider / if the hardware under its gone to pot they'll notify you and migrate the machine.
AWS is just one big rotating middle finger to your vms when it comes to stuff like that. Change it yourself; or we've murdered it, hope there wasn't anything important on there
joshmyers
joshmyersover 7 years ago
Any folks using fargate here? Good tooling/frameworks?
joshmyers
joshmyersover 7 years ago
Am tempted to go with airship as feels robust
joshmyers
joshmyersover 7 years ago
But also kinda like the idea of fargate cli for unlimited staging environments
joshmyers
joshmyersover 7 years ago
Which means the ECS is out of Terraform control
ciastek
ciastekover 7 years ago
Don't forget about limit of 50 Fargate tasks per region, per account.
Maarten van der Hoef
Maarten van der Hoefover 7 years ago
Limits can be changed, fargate is just very expensive if you're doing 50 🙂
Steven
Stevenover 7 years ago
Fargate is a lot cheaper than it used to be. Fargate limits can be increased to 1000's if needed. I think I have it at 3000 in 2 accounts.
PePe Amengual
PePe Amengualover 7 years ago
Anyone have an idea to how to change the the ecs agent docker image directory to use something else instead of /var/lib/docker ?
PePe Amengual
PePe Amengualover 7 years ago
in an ECS optimized instance the agent is already pulled and started
Sharanya
Sharanyaover 7 years ago
Hey Folks, Trying to find some Terraform Modules related to AWS - app stream service ( for creating fleets and stacks) any help appreciated
Partha
Parthaover 7 years ago
Hi All,
Is there any way to setup alert for RDS Slow QRY log