Very slow copying files from ExFat to NTFS
I got stuck in a mess.
I have a 2T WD Elements HD mounted in ExFat that was not recognized anymore from my mac and my Windows. Reading on the internet i found that maybe linux could help me to get out of this mess (i have all my stuff there), so i installed Ubuntu 18.04 with parallels on my mac.
I can't get the HD as well but then i found this: sudo apt-get install exfat-fuse exfat-utils and voilà, my WD Elements is finally back again.
So now i'm trying to copy the most important stuff in my new HD (a 2TB NTFS Toshiba) but the copy is ridiculously slow, like <1mb and they are both usb 3.0; to copy 40GB it needs 68h!
So what do you suggest me to do?
use ubuntu with a partition on my mac, instead using the virtual box?
change the format of my new toshiba HD?
others?
Thanks.
partitioning mount hard-drive ntfs exfat
New contributor
Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
I got stuck in a mess.
I have a 2T WD Elements HD mounted in ExFat that was not recognized anymore from my mac and my Windows. Reading on the internet i found that maybe linux could help me to get out of this mess (i have all my stuff there), so i installed Ubuntu 18.04 with parallels on my mac.
I can't get the HD as well but then i found this: sudo apt-get install exfat-fuse exfat-utils and voilà, my WD Elements is finally back again.
So now i'm trying to copy the most important stuff in my new HD (a 2TB NTFS Toshiba) but the copy is ridiculously slow, like <1mb and they are both usb 3.0; to copy 40GB it needs 68h!
So what do you suggest me to do?
use ubuntu with a partition on my mac, instead using the virtual box?
change the format of my new toshiba HD?
others?
Thanks.
partitioning mount hard-drive ntfs exfat
New contributor
Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
I got stuck in a mess.
I have a 2T WD Elements HD mounted in ExFat that was not recognized anymore from my mac and my Windows. Reading on the internet i found that maybe linux could help me to get out of this mess (i have all my stuff there), so i installed Ubuntu 18.04 with parallels on my mac.
I can't get the HD as well but then i found this: sudo apt-get install exfat-fuse exfat-utils and voilà, my WD Elements is finally back again.
So now i'm trying to copy the most important stuff in my new HD (a 2TB NTFS Toshiba) but the copy is ridiculously slow, like <1mb and they are both usb 3.0; to copy 40GB it needs 68h!
So what do you suggest me to do?
use ubuntu with a partition on my mac, instead using the virtual box?
change the format of my new toshiba HD?
others?
Thanks.
partitioning mount hard-drive ntfs exfat
New contributor
Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
I got stuck in a mess.
I have a 2T WD Elements HD mounted in ExFat that was not recognized anymore from my mac and my Windows. Reading on the internet i found that maybe linux could help me to get out of this mess (i have all my stuff there), so i installed Ubuntu 18.04 with parallels on my mac.
I can't get the HD as well but then i found this: sudo apt-get install exfat-fuse exfat-utils and voilà, my WD Elements is finally back again.
So now i'm trying to copy the most important stuff in my new HD (a 2TB NTFS Toshiba) but the copy is ridiculously slow, like <1mb and they are both usb 3.0; to copy 40GB it needs 68h!
So what do you suggest me to do?
use ubuntu with a partition on my mac, instead using the virtual box?
change the format of my new toshiba HD?
others?
Thanks.
partitioning mount hard-drive ntfs exfat
partitioning mount hard-drive ntfs exfat
New contributor
Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
asked 2 days ago
Mattia EleftheriouMattia Eleftheriou
1
1
New contributor
Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
New contributor
Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
add a comment |
add a comment |
3 Answers
3
active
oldest
votes
You can load Ubuntu onto a live USB drive and do the same things without having to install it to a partition on your Mac. Despite being in "live" mode you are able to install packages using apt although all data is being stored into memory.
Your HDD is likely failing and usually before a disk fails it becomes slow. It's also very likely the disk will completely fail before you can access the entire contents, so you should be careful to grab the most important documents first and avoid doing anything that can stress the disk, such as prolonged operations.
If you load a SMART utility you can likely see it's failing with metrics provided. See this question for information on how to view the SMART status of a disk and your Mac also should have tools to do this.
Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD
– Mattia Eleftheriou
2 days ago
I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.
– Kristopher Ives
2 days ago
add a comment |
You can use ddrescue to clone the failing (?) drive to another drive with at least the same size (not one single byte smaller). ddrescue is good at reading sectors (on a drive) that are failing: 'almost bad = difficult to read'.
If the target drive with the cloned copy has a different size than the source drive (the failing one), and there is a GUID partition table, GPT, you have to repair the backup partition table with gdisk or easier with gpt-fix. This is not necessary if there is an MSDOS partition table.
Then you can do the repair work on the cloned copy and/or copying from the cloned copy.
See these links with more details,
How do I clone a failing hard drive to a new hard drive using ubuntu
Repair the partition table and file system of a pendrive - Scroll down to 'Advanced repair of a partition table, file system and/or recovery of files'
when i runsudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.logit asks me to use--force, but nothing seems to happen...
– Mattia Eleftheriou
2 days ago
1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can installiotopand runsudo iotop -ois a separate terminal window in order to see if there is any read and write activity.
– sudodus
2 days ago
add a comment |
I have found that using a program like tar or cpio which allows you to specify a buffer size can speed up large copies. Apparently putting the buffers into userspace avoids some system memory thrashing which brings things to a crawl. Use a buffer size of at least 2M, which I found gave me a 3x speed improvement (larger may be even better, since for you, 3x is still only 3M /sec).
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "89"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Mattia Eleftheriou is a new contributor. Be nice, and check out our Code of Conduct.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2faskubuntu.com%2fquestions%2f1113235%2fvery-slow-copying-files-from-exfat-to-ntfs%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
3 Answers
3
active
oldest
votes
3 Answers
3
active
oldest
votes
active
oldest
votes
active
oldest
votes
You can load Ubuntu onto a live USB drive and do the same things without having to install it to a partition on your Mac. Despite being in "live" mode you are able to install packages using apt although all data is being stored into memory.
Your HDD is likely failing and usually before a disk fails it becomes slow. It's also very likely the disk will completely fail before you can access the entire contents, so you should be careful to grab the most important documents first and avoid doing anything that can stress the disk, such as prolonged operations.
If you load a SMART utility you can likely see it's failing with metrics provided. See this question for information on how to view the SMART status of a disk and your Mac also should have tools to do this.
Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD
– Mattia Eleftheriou
2 days ago
I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.
– Kristopher Ives
2 days ago
add a comment |
You can load Ubuntu onto a live USB drive and do the same things without having to install it to a partition on your Mac. Despite being in "live" mode you are able to install packages using apt although all data is being stored into memory.
Your HDD is likely failing and usually before a disk fails it becomes slow. It's also very likely the disk will completely fail before you can access the entire contents, so you should be careful to grab the most important documents first and avoid doing anything that can stress the disk, such as prolonged operations.
If you load a SMART utility you can likely see it's failing with metrics provided. See this question for information on how to view the SMART status of a disk and your Mac also should have tools to do this.
Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD
– Mattia Eleftheriou
2 days ago
I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.
– Kristopher Ives
2 days ago
add a comment |
You can load Ubuntu onto a live USB drive and do the same things without having to install it to a partition on your Mac. Despite being in "live" mode you are able to install packages using apt although all data is being stored into memory.
Your HDD is likely failing and usually before a disk fails it becomes slow. It's also very likely the disk will completely fail before you can access the entire contents, so you should be careful to grab the most important documents first and avoid doing anything that can stress the disk, such as prolonged operations.
If you load a SMART utility you can likely see it's failing with metrics provided. See this question for information on how to view the SMART status of a disk and your Mac also should have tools to do this.
You can load Ubuntu onto a live USB drive and do the same things without having to install it to a partition on your Mac. Despite being in "live" mode you are able to install packages using apt although all data is being stored into memory.
Your HDD is likely failing and usually before a disk fails it becomes slow. It's also very likely the disk will completely fail before you can access the entire contents, so you should be careful to grab the most important documents first and avoid doing anything that can stress the disk, such as prolonged operations.
If you load a SMART utility you can likely see it's failing with metrics provided. See this question for information on how to view the SMART status of a disk and your Mac also should have tools to do this.
answered 2 days ago
Kristopher IvesKristopher Ives
2,45111122
2,45111122
Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD
– Mattia Eleftheriou
2 days ago
I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.
– Kristopher Ives
2 days ago
add a comment |
Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD
– Mattia Eleftheriou
2 days ago
I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.
– Kristopher Ives
2 days ago
Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD
– Mattia Eleftheriou
2 days ago
Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD
– Mattia Eleftheriou
2 days ago
I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.
– Kristopher Ives
2 days ago
I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.
– Kristopher Ives
2 days ago
add a comment |
You can use ddrescue to clone the failing (?) drive to another drive with at least the same size (not one single byte smaller). ddrescue is good at reading sectors (on a drive) that are failing: 'almost bad = difficult to read'.
If the target drive with the cloned copy has a different size than the source drive (the failing one), and there is a GUID partition table, GPT, you have to repair the backup partition table with gdisk or easier with gpt-fix. This is not necessary if there is an MSDOS partition table.
Then you can do the repair work on the cloned copy and/or copying from the cloned copy.
See these links with more details,
How do I clone a failing hard drive to a new hard drive using ubuntu
Repair the partition table and file system of a pendrive - Scroll down to 'Advanced repair of a partition table, file system and/or recovery of files'
when i runsudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.logit asks me to use--force, but nothing seems to happen...
– Mattia Eleftheriou
2 days ago
1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can installiotopand runsudo iotop -ois a separate terminal window in order to see if there is any read and write activity.
– sudodus
2 days ago
add a comment |
You can use ddrescue to clone the failing (?) drive to another drive with at least the same size (not one single byte smaller). ddrescue is good at reading sectors (on a drive) that are failing: 'almost bad = difficult to read'.
If the target drive with the cloned copy has a different size than the source drive (the failing one), and there is a GUID partition table, GPT, you have to repair the backup partition table with gdisk or easier with gpt-fix. This is not necessary if there is an MSDOS partition table.
Then you can do the repair work on the cloned copy and/or copying from the cloned copy.
See these links with more details,
How do I clone a failing hard drive to a new hard drive using ubuntu
Repair the partition table and file system of a pendrive - Scroll down to 'Advanced repair of a partition table, file system and/or recovery of files'
when i runsudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.logit asks me to use--force, but nothing seems to happen...
– Mattia Eleftheriou
2 days ago
1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can installiotopand runsudo iotop -ois a separate terminal window in order to see if there is any read and write activity.
– sudodus
2 days ago
add a comment |
You can use ddrescue to clone the failing (?) drive to another drive with at least the same size (not one single byte smaller). ddrescue is good at reading sectors (on a drive) that are failing: 'almost bad = difficult to read'.
If the target drive with the cloned copy has a different size than the source drive (the failing one), and there is a GUID partition table, GPT, you have to repair the backup partition table with gdisk or easier with gpt-fix. This is not necessary if there is an MSDOS partition table.
Then you can do the repair work on the cloned copy and/or copying from the cloned copy.
See these links with more details,
How do I clone a failing hard drive to a new hard drive using ubuntu
Repair the partition table and file system of a pendrive - Scroll down to 'Advanced repair of a partition table, file system and/or recovery of files'
You can use ddrescue to clone the failing (?) drive to another drive with at least the same size (not one single byte smaller). ddrescue is good at reading sectors (on a drive) that are failing: 'almost bad = difficult to read'.
If the target drive with the cloned copy has a different size than the source drive (the failing one), and there is a GUID partition table, GPT, you have to repair the backup partition table with gdisk or easier with gpt-fix. This is not necessary if there is an MSDOS partition table.
Then you can do the repair work on the cloned copy and/or copying from the cloned copy.
See these links with more details,
How do I clone a failing hard drive to a new hard drive using ubuntu
Repair the partition table and file system of a pendrive - Scroll down to 'Advanced repair of a partition table, file system and/or recovery of files'
answered 2 days ago
sudodussudodus
23.8k32874
23.8k32874
when i runsudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.logit asks me to use--force, but nothing seems to happen...
– Mattia Eleftheriou
2 days ago
1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can installiotopand runsudo iotop -ois a separate terminal window in order to see if there is any read and write activity.
– sudodus
2 days ago
add a comment |
when i runsudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.logit asks me to use--force, but nothing seems to happen...
– Mattia Eleftheriou
2 days ago
1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can installiotopand runsudo iotop -ois a separate terminal window in order to see if there is any read and write activity.
– sudodus
2 days ago
when i run
sudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.log it asks me to use --force , but nothing seems to happen...– Mattia Eleftheriou
2 days ago
when i run
sudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.log it asks me to use --force , but nothing seems to happen...– Mattia Eleftheriou
2 days ago
1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can install
iotop and run sudo iotop -o is a separate terminal window in order to see if there is any read and write activity.– sudodus
2 days ago
1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can install
iotop and run sudo iotop -o is a separate terminal window in order to see if there is any read and write activity.– sudodus
2 days ago
add a comment |
I have found that using a program like tar or cpio which allows you to specify a buffer size can speed up large copies. Apparently putting the buffers into userspace avoids some system memory thrashing which brings things to a crawl. Use a buffer size of at least 2M, which I found gave me a 3x speed improvement (larger may be even better, since for you, 3x is still only 3M /sec).
add a comment |
I have found that using a program like tar or cpio which allows you to specify a buffer size can speed up large copies. Apparently putting the buffers into userspace avoids some system memory thrashing which brings things to a crawl. Use a buffer size of at least 2M, which I found gave me a 3x speed improvement (larger may be even better, since for you, 3x is still only 3M /sec).
add a comment |
I have found that using a program like tar or cpio which allows you to specify a buffer size can speed up large copies. Apparently putting the buffers into userspace avoids some system memory thrashing which brings things to a crawl. Use a buffer size of at least 2M, which I found gave me a 3x speed improvement (larger may be even better, since for you, 3x is still only 3M /sec).
I have found that using a program like tar or cpio which allows you to specify a buffer size can speed up large copies. Apparently putting the buffers into userspace avoids some system memory thrashing which brings things to a crawl. Use a buffer size of at least 2M, which I found gave me a 3x speed improvement (larger may be even better, since for you, 3x is still only 3M /sec).
answered 2 days ago
ubfan1ubfan1
9,41641527
9,41641527
add a comment |
add a comment |
Mattia Eleftheriou is a new contributor. Be nice, and check out our Code of Conduct.
Mattia Eleftheriou is a new contributor. Be nice, and check out our Code of Conduct.
Mattia Eleftheriou is a new contributor. Be nice, and check out our Code of Conduct.
Mattia Eleftheriou is a new contributor. Be nice, and check out our Code of Conduct.
Thanks for contributing an answer to Ask Ubuntu!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2faskubuntu.com%2fquestions%2f1113235%2fvery-slow-copying-files-from-exfat-to-ntfs%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown