Whole website no-index, no-follow
I am using Magento 2, and I have staging server, I don't want any crawler or bots to index my staging server.
So, I need whole website to be no-index, no follow. Is it possible in Magento?
magento2
add a comment |
I am using Magento 2, and I have staging server, I don't want any crawler or bots to index my staging server.
So, I need whole website to be no-index, no follow. Is it possible in Magento?
magento2
1
add this in layout<head> <meta name="robots" content="NOINDEX,NOFOLLOW"/> </head>
– Rakesh Donga
2 days ago
Thanks Rakesh Donga
– Asim Ali
2 days ago
add a comment |
I am using Magento 2, and I have staging server, I don't want any crawler or bots to index my staging server.
So, I need whole website to be no-index, no follow. Is it possible in Magento?
magento2
I am using Magento 2, and I have staging server, I don't want any crawler or bots to index my staging server.
So, I need whole website to be no-index, no follow. Is it possible in Magento?
magento2
magento2
asked 2 days ago
Asim AliAsim Ali
7710
7710
1
add this in layout<head> <meta name="robots" content="NOINDEX,NOFOLLOW"/> </head>
– Rakesh Donga
2 days ago
Thanks Rakesh Donga
– Asim Ali
2 days ago
add a comment |
1
add this in layout<head> <meta name="robots" content="NOINDEX,NOFOLLOW"/> </head>
– Rakesh Donga
2 days ago
Thanks Rakesh Donga
– Asim Ali
2 days ago
1
1
add this in layout
<head> <meta name="robots" content="NOINDEX,NOFOLLOW"/> </head>
– Rakesh Donga
2 days ago
add this in layout
<head> <meta name="robots" content="NOINDEX,NOFOLLOW"/> </head>
– Rakesh Donga
2 days ago
Thanks Rakesh Donga
– Asim Ali
2 days ago
Thanks Rakesh Donga
– Asim Ali
2 days ago
add a comment |
2 Answers
2
active
oldest
votes
Go to configuration
Content -> Design -> Configuration
Edit Global configuration
In Search Engine Robots tab, you can set Default Robots value to "Noindex, Nofollow"
In addition, create file robots.txt
in root
and pub/
directory. File content would be:
User-Agent: *
Disallow: /
Thanks Shoaib Munir
– Asim Ali
2 days ago
add a comment |
You do not want to remove the tag from the code as this is a back-end setting. You can change the setting by logging in to your back-office then go to
Content -> Design -> Configuration
then click on the correct storeview. Under the tab Search Engine Robots
you find the option
Thanks Rathod..
– Asim Ali
2 days ago
working or not ?
– Ronak Rathod
2 days ago
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
2 days ago
Good answer though. +1
– Shoaib Munir
yesterday
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "479"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmagento.stackexchange.com%2fquestions%2f267581%2fwhole-website-no-index-no-follow%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
Go to configuration
Content -> Design -> Configuration
Edit Global configuration
In Search Engine Robots tab, you can set Default Robots value to "Noindex, Nofollow"
In addition, create file robots.txt
in root
and pub/
directory. File content would be:
User-Agent: *
Disallow: /
Thanks Shoaib Munir
– Asim Ali
2 days ago
add a comment |
Go to configuration
Content -> Design -> Configuration
Edit Global configuration
In Search Engine Robots tab, you can set Default Robots value to "Noindex, Nofollow"
In addition, create file robots.txt
in root
and pub/
directory. File content would be:
User-Agent: *
Disallow: /
Thanks Shoaib Munir
– Asim Ali
2 days ago
add a comment |
Go to configuration
Content -> Design -> Configuration
Edit Global configuration
In Search Engine Robots tab, you can set Default Robots value to "Noindex, Nofollow"
In addition, create file robots.txt
in root
and pub/
directory. File content would be:
User-Agent: *
Disallow: /
Go to configuration
Content -> Design -> Configuration
Edit Global configuration
In Search Engine Robots tab, you can set Default Robots value to "Noindex, Nofollow"
In addition, create file robots.txt
in root
and pub/
directory. File content would be:
User-Agent: *
Disallow: /
answered 2 days ago
Shoaib MunirShoaib Munir
2,3072829
2,3072829
Thanks Shoaib Munir
– Asim Ali
2 days ago
add a comment |
Thanks Shoaib Munir
– Asim Ali
2 days ago
Thanks Shoaib Munir
– Asim Ali
2 days ago
Thanks Shoaib Munir
– Asim Ali
2 days ago
add a comment |
You do not want to remove the tag from the code as this is a back-end setting. You can change the setting by logging in to your back-office then go to
Content -> Design -> Configuration
then click on the correct storeview. Under the tab Search Engine Robots
you find the option
Thanks Rathod..
– Asim Ali
2 days ago
working or not ?
– Ronak Rathod
2 days ago
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
2 days ago
Good answer though. +1
– Shoaib Munir
yesterday
add a comment |
You do not want to remove the tag from the code as this is a back-end setting. You can change the setting by logging in to your back-office then go to
Content -> Design -> Configuration
then click on the correct storeview. Under the tab Search Engine Robots
you find the option
Thanks Rathod..
– Asim Ali
2 days ago
working or not ?
– Ronak Rathod
2 days ago
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
2 days ago
Good answer though. +1
– Shoaib Munir
yesterday
add a comment |
You do not want to remove the tag from the code as this is a back-end setting. You can change the setting by logging in to your back-office then go to
Content -> Design -> Configuration
then click on the correct storeview. Under the tab Search Engine Robots
you find the option
You do not want to remove the tag from the code as this is a back-end setting. You can change the setting by logging in to your back-office then go to
Content -> Design -> Configuration
then click on the correct storeview. Under the tab Search Engine Robots
you find the option
answered 2 days ago
Ronak RathodRonak Rathod
755112
755112
Thanks Rathod..
– Asim Ali
2 days ago
working or not ?
– Ronak Rathod
2 days ago
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
2 days ago
Good answer though. +1
– Shoaib Munir
yesterday
add a comment |
Thanks Rathod..
– Asim Ali
2 days ago
working or not ?
– Ronak Rathod
2 days ago
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
2 days ago
Good answer though. +1
– Shoaib Munir
yesterday
Thanks Rathod..
– Asim Ali
2 days ago
Thanks Rathod..
– Asim Ali
2 days ago
working or not ?
– Ronak Rathod
2 days ago
working or not ?
– Ronak Rathod
2 days ago
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
2 days ago
Yes working, but adding robots.txt is also a good solution. I cannot mark two answer correct, otherwise I would do that. +1
– Asim Ali
2 days ago
Good answer though. +1
– Shoaib Munir
yesterday
Good answer though. +1
– Shoaib Munir
yesterday
add a comment |
Thanks for contributing an answer to Magento Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmagento.stackexchange.com%2fquestions%2f267581%2fwhole-website-no-index-no-follow%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
add this in layout
<head> <meta name="robots" content="NOINDEX,NOFOLLOW"/> </head>
– Rakesh Donga
2 days ago
Thanks Rakesh Donga
– Asim Ali
2 days ago