How to hide elasticbeanstalk.com address from public(search engine crawlers)

amazon-web-serviceselastic-beanstalkgodaddyseo

I have purchased a domain from godaddy( mentioning here as xyz.com ). I have hosted my website on aws using elasticbeanstalk which has generated a cname (mentioning here as abc.elasticbeanstalk.com).

Now in godaddy I have done 2 configurations:
1. Forward xyz.com to www.xyz.com
2. Mapped cname www to abc.elasticbeanstalk.com

xyz.com & www.xyz.com opens properly in browser and everything seems to be fine.

The problem is search engines are displaying abc.elasticbeanstalk.com in search results for keywords related to xyz.com.

I want to keep abc.elasticbeanstalk.com hidden from all these search engine crawlers. Has anyone faced this problem before?

Best Answer

You can set a canonical URL for the site:

<link rel="canonical" href="https://example.com/current/request/uri" />

Another possible solution is setting a custom Apache configuration to redirect visitors hitting the EB domain. This requires a custom AMI for your EB installation.

Related Solutions

Amazon EC2 – How to Download Public Key from Amazon AWS

Nice puzzle, thanks! Here's one answer:

Start a new, temporary EBS boot t1.micro instance A, specifying keypair p2. Specify an availability zone where you have another instance B already running and to which you have access. (Start a temporary one if needed).
Stop (not terminate) the instance A after it has been in the running state for a few minutes, so it has a chance to save the public key to its authorized_keys file.
Detach the root EBS volume from the stopped instance A. Attach and mount it to your running instance B.
Copy the public key from the mounted file system.
Detach and delete the EBS volume. Terminate the temporary instance A.

AWS CLI – How to Search EC2 Instance by Name

Assuming that you are using the convention of putting the name of the instance in a tag with the key of "Name" (this is what the AWS Console does when you enter a name), then you can use the --filters option to list those instances with aws-cli:

aws ec2 describe-instances --filters 'Name=tag:Name,Values=dev-server-*'

If you just wanted the instance ids of those instances, you could use:

aws ec2 describe-instances --filters 'Name=tag:Name,Values=dev-server-*' \
  --output text --query 'Reservations[*].Instances[*].InstanceId'

Note: --query may require a recent version of aws-cli but it's worth getting.

Best Answer

Related Solutions

Amazon EC2 – How to Download Public Key from Amazon AWS

AWS CLI – How to Search EC2 Instance by Name

Related Topic