Very slow copying files from ExFat to NTFS












0















I got stuck in a mess.



I have a 2T WD Elements HD mounted in ExFat that was not recognized anymore from my mac and my Windows. Reading on the internet i found that maybe linux could help me to get out of this mess (i have all my stuff there), so i installed Ubuntu 18.04 with parallels on my mac.
I can't get the HD as well but then i found this: sudo apt-get install exfat-fuse exfat-utils and voilà, my WD Elements is finally back again.
So now i'm trying to copy the most important stuff in my new HD (a 2TB NTFS Toshiba) but the copy is ridiculously slow, like <1mb and they are both usb 3.0; to copy 40GB it needs 68h!



So what do you suggest me to do?
use ubuntu with a partition on my mac, instead using the virtual box?
change the format of my new toshiba HD?
others?
Thanks.










share|improve this question







New contributor




Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.

























    0















    I got stuck in a mess.



    I have a 2T WD Elements HD mounted in ExFat that was not recognized anymore from my mac and my Windows. Reading on the internet i found that maybe linux could help me to get out of this mess (i have all my stuff there), so i installed Ubuntu 18.04 with parallels on my mac.
    I can't get the HD as well but then i found this: sudo apt-get install exfat-fuse exfat-utils and voilà, my WD Elements is finally back again.
    So now i'm trying to copy the most important stuff in my new HD (a 2TB NTFS Toshiba) but the copy is ridiculously slow, like <1mb and they are both usb 3.0; to copy 40GB it needs 68h!



    So what do you suggest me to do?
    use ubuntu with a partition on my mac, instead using the virtual box?
    change the format of my new toshiba HD?
    others?
    Thanks.










    share|improve this question







    New contributor




    Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.























      0












      0








      0








      I got stuck in a mess.



      I have a 2T WD Elements HD mounted in ExFat that was not recognized anymore from my mac and my Windows. Reading on the internet i found that maybe linux could help me to get out of this mess (i have all my stuff there), so i installed Ubuntu 18.04 with parallels on my mac.
      I can't get the HD as well but then i found this: sudo apt-get install exfat-fuse exfat-utils and voilà, my WD Elements is finally back again.
      So now i'm trying to copy the most important stuff in my new HD (a 2TB NTFS Toshiba) but the copy is ridiculously slow, like <1mb and they are both usb 3.0; to copy 40GB it needs 68h!



      So what do you suggest me to do?
      use ubuntu with a partition on my mac, instead using the virtual box?
      change the format of my new toshiba HD?
      others?
      Thanks.










      share|improve this question







      New contributor




      Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.












      I got stuck in a mess.



      I have a 2T WD Elements HD mounted in ExFat that was not recognized anymore from my mac and my Windows. Reading on the internet i found that maybe linux could help me to get out of this mess (i have all my stuff there), so i installed Ubuntu 18.04 with parallels on my mac.
      I can't get the HD as well but then i found this: sudo apt-get install exfat-fuse exfat-utils and voilà, my WD Elements is finally back again.
      So now i'm trying to copy the most important stuff in my new HD (a 2TB NTFS Toshiba) but the copy is ridiculously slow, like <1mb and they are both usb 3.0; to copy 40GB it needs 68h!



      So what do you suggest me to do?
      use ubuntu with a partition on my mac, instead using the virtual box?
      change the format of my new toshiba HD?
      others?
      Thanks.







      partitioning mount hard-drive ntfs exfat






      share|improve this question







      New contributor




      Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      share|improve this question







      New contributor




      Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      share|improve this question




      share|improve this question






      New contributor




      Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked 2 days ago









      Mattia EleftheriouMattia Eleftheriou

      1




      1




      New contributor




      Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      Mattia Eleftheriou is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






















          3 Answers
          3






          active

          oldest

          votes


















          2














          You can load Ubuntu onto a live USB drive and do the same things without having to install it to a partition on your Mac. Despite being in "live" mode you are able to install packages using apt although all data is being stored into memory.



          Your HDD is likely failing and usually before a disk fails it becomes slow. It's also very likely the disk will completely fail before you can access the entire contents, so you should be careful to grab the most important documents first and avoid doing anything that can stress the disk, such as prolonged operations.



          If you load a SMART utility you can likely see it's failing with metrics provided. See this question for information on how to view the SMART status of a disk and your Mac also should have tools to do this.






          share|improve this answer
























          • Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD

            – Mattia Eleftheriou
            2 days ago











          • I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.

            – Kristopher Ives
            2 days ago



















          0














          You can use ddrescue to clone the failing (?) drive to another drive with at least the same size (not one single byte smaller). ddrescue is good at reading sectors (on a drive) that are failing: 'almost bad = difficult to read'.



          If the target drive with the cloned copy has a different size than the source drive (the failing one), and there is a GUID partition table, GPT, you have to repair the backup partition table with gdisk or easier with gpt-fix. This is not necessary if there is an MSDOS partition table.



          Then you can do the repair work on the cloned copy and/or copying from the cloned copy.



          See these links with more details,




          • How do I clone a failing hard drive to a new hard drive using ubuntu


          • Repair the partition table and file system of a pendrive - Scroll down to 'Advanced repair of a partition table, file system and/or recovery of files'







          share|improve this answer
























          • when i run sudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.log it asks me to use --force , but nothing seems to happen...

            – Mattia Eleftheriou
            2 days ago











          • 1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can install iotop and run sudo iotop -o is a separate terminal window in order to see if there is any read and write activity.

            – sudodus
            2 days ago



















          0














          I have found that using a program like tar or cpio which allows you to specify a buffer size can speed up large copies. Apparently putting the buffers into userspace avoids some system memory thrashing which brings things to a crawl. Use a buffer size of at least 2M, which I found gave me a 3x speed improvement (larger may be even better, since for you, 3x is still only 3M /sec).






          share|improve this answer























            Your Answer








            StackExchange.ready(function() {
            var channelOptions = {
            tags: "".split(" "),
            id: "89"
            };
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function() {
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled) {
            StackExchange.using("snippets", function() {
            createEditor();
            });
            }
            else {
            createEditor();
            }
            });

            function createEditor() {
            StackExchange.prepareEditor({
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: true,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: 10,
            bindNavPrevention: true,
            postfix: "",
            imageUploader: {
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            },
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            });


            }
            });






            Mattia Eleftheriou is a new contributor. Be nice, and check out our Code of Conduct.










            draft saved

            draft discarded


















            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2faskubuntu.com%2fquestions%2f1113235%2fvery-slow-copying-files-from-exfat-to-ntfs%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown

























            3 Answers
            3






            active

            oldest

            votes








            3 Answers
            3






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            2














            You can load Ubuntu onto a live USB drive and do the same things without having to install it to a partition on your Mac. Despite being in "live" mode you are able to install packages using apt although all data is being stored into memory.



            Your HDD is likely failing and usually before a disk fails it becomes slow. It's also very likely the disk will completely fail before you can access the entire contents, so you should be careful to grab the most important documents first and avoid doing anything that can stress the disk, such as prolonged operations.



            If you load a SMART utility you can likely see it's failing with metrics provided. See this question for information on how to view the SMART status of a disk and your Mac also should have tools to do this.






            share|improve this answer
























            • Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD

              – Mattia Eleftheriou
              2 days ago











            • I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.

              – Kristopher Ives
              2 days ago
















            2














            You can load Ubuntu onto a live USB drive and do the same things without having to install it to a partition on your Mac. Despite being in "live" mode you are able to install packages using apt although all data is being stored into memory.



            Your HDD is likely failing and usually before a disk fails it becomes slow. It's also very likely the disk will completely fail before you can access the entire contents, so you should be careful to grab the most important documents first and avoid doing anything that can stress the disk, such as prolonged operations.



            If you load a SMART utility you can likely see it's failing with metrics provided. See this question for information on how to view the SMART status of a disk and your Mac also should have tools to do this.






            share|improve this answer
























            • Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD

              – Mattia Eleftheriou
              2 days ago











            • I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.

              – Kristopher Ives
              2 days ago














            2












            2








            2







            You can load Ubuntu onto a live USB drive and do the same things without having to install it to a partition on your Mac. Despite being in "live" mode you are able to install packages using apt although all data is being stored into memory.



            Your HDD is likely failing and usually before a disk fails it becomes slow. It's also very likely the disk will completely fail before you can access the entire contents, so you should be careful to grab the most important documents first and avoid doing anything that can stress the disk, such as prolonged operations.



            If you load a SMART utility you can likely see it's failing with metrics provided. See this question for information on how to view the SMART status of a disk and your Mac also should have tools to do this.






            share|improve this answer













            You can load Ubuntu onto a live USB drive and do the same things without having to install it to a partition on your Mac. Despite being in "live" mode you are able to install packages using apt although all data is being stored into memory.



            Your HDD is likely failing and usually before a disk fails it becomes slow. It's also very likely the disk will completely fail before you can access the entire contents, so you should be careful to grab the most important documents first and avoid doing anything that can stress the disk, such as prolonged operations.



            If you load a SMART utility you can likely see it's failing with metrics provided. See this question for information on how to view the SMART status of a disk and your Mac also should have tools to do this.







            share|improve this answer












            share|improve this answer



            share|improve this answer










            answered 2 days ago









            Kristopher IvesKristopher Ives

            2,45111122




            2,45111122













            • Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD

              – Mattia Eleftheriou
              2 days ago











            • I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.

              – Kristopher Ives
              2 days ago



















            • Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD

              – Mattia Eleftheriou
              2 days ago











            • I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.

              – Kristopher Ives
              2 days ago

















            Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD

            – Mattia Eleftheriou
            2 days ago





            Thanks! so using ubuntu on a 32GB USB will be faster? i just want to copy my stuff as soon as possible and format the ExFat HD

            – Mattia Eleftheriou
            2 days ago













            I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.

            – Kristopher Ives
            2 days ago





            I can't say if it will be faster, but it's pretty easy to try. The disk copy is likely slow because the disk is likely damaged and will fail soon. It's possible that VirtualBox being used on the Mac is causing it to be slow.

            – Kristopher Ives
            2 days ago













            0














            You can use ddrescue to clone the failing (?) drive to another drive with at least the same size (not one single byte smaller). ddrescue is good at reading sectors (on a drive) that are failing: 'almost bad = difficult to read'.



            If the target drive with the cloned copy has a different size than the source drive (the failing one), and there is a GUID partition table, GPT, you have to repair the backup partition table with gdisk or easier with gpt-fix. This is not necessary if there is an MSDOS partition table.



            Then you can do the repair work on the cloned copy and/or copying from the cloned copy.



            See these links with more details,




            • How do I clone a failing hard drive to a new hard drive using ubuntu


            • Repair the partition table and file system of a pendrive - Scroll down to 'Advanced repair of a partition table, file system and/or recovery of files'







            share|improve this answer
























            • when i run sudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.log it asks me to use --force , but nothing seems to happen...

              – Mattia Eleftheriou
              2 days ago











            • 1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can install iotop and run sudo iotop -o is a separate terminal window in order to see if there is any read and write activity.

              – sudodus
              2 days ago
















            0














            You can use ddrescue to clone the failing (?) drive to another drive with at least the same size (not one single byte smaller). ddrescue is good at reading sectors (on a drive) that are failing: 'almost bad = difficult to read'.



            If the target drive with the cloned copy has a different size than the source drive (the failing one), and there is a GUID partition table, GPT, you have to repair the backup partition table with gdisk or easier with gpt-fix. This is not necessary if there is an MSDOS partition table.



            Then you can do the repair work on the cloned copy and/or copying from the cloned copy.



            See these links with more details,




            • How do I clone a failing hard drive to a new hard drive using ubuntu


            • Repair the partition table and file system of a pendrive - Scroll down to 'Advanced repair of a partition table, file system and/or recovery of files'







            share|improve this answer
























            • when i run sudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.log it asks me to use --force , but nothing seems to happen...

              – Mattia Eleftheriou
              2 days ago











            • 1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can install iotop and run sudo iotop -o is a separate terminal window in order to see if there is any read and write activity.

              – sudodus
              2 days ago














            0












            0








            0







            You can use ddrescue to clone the failing (?) drive to another drive with at least the same size (not one single byte smaller). ddrescue is good at reading sectors (on a drive) that are failing: 'almost bad = difficult to read'.



            If the target drive with the cloned copy has a different size than the source drive (the failing one), and there is a GUID partition table, GPT, you have to repair the backup partition table with gdisk or easier with gpt-fix. This is not necessary if there is an MSDOS partition table.



            Then you can do the repair work on the cloned copy and/or copying from the cloned copy.



            See these links with more details,




            • How do I clone a failing hard drive to a new hard drive using ubuntu


            • Repair the partition table and file system of a pendrive - Scroll down to 'Advanced repair of a partition table, file system and/or recovery of files'







            share|improve this answer













            You can use ddrescue to clone the failing (?) drive to another drive with at least the same size (not one single byte smaller). ddrescue is good at reading sectors (on a drive) that are failing: 'almost bad = difficult to read'.



            If the target drive with the cloned copy has a different size than the source drive (the failing one), and there is a GUID partition table, GPT, you have to repair the backup partition table with gdisk or easier with gpt-fix. This is not necessary if there is an MSDOS partition table.



            Then you can do the repair work on the cloned copy and/or copying from the cloned copy.



            See these links with more details,




            • How do I clone a failing hard drive to a new hard drive using ubuntu


            • Repair the partition table and file system of a pendrive - Scroll down to 'Advanced repair of a partition table, file system and/or recovery of files'








            share|improve this answer












            share|improve this answer



            share|improve this answer










            answered 2 days ago









            sudodussudodus

            23.8k32874




            23.8k32874













            • when i run sudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.log it asks me to use --force , but nothing seems to happen...

              – Mattia Eleftheriou
              2 days ago











            • 1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can install iotop and run sudo iotop -o is a separate terminal window in order to see if there is any read and write activity.

              – sudodus
              2 days ago



















            • when i run sudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.log it asks me to use --force , but nothing seems to happen...

              – Mattia Eleftheriou
              2 days ago











            • 1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can install iotop and run sudo iotop -o is a separate terminal window in order to see if there is any read and write activity.

              – sudodus
              2 days ago

















            when i run sudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.log it asks me to use --force , but nothing seems to happen...

            – Mattia Eleftheriou
            2 days ago





            when i run sudo ddrescue -d -r3 /dev/sdc /dev/sdb /path/to/rescue.log it asks me to use --force , but nothing seems to happen...

            – Mattia Eleftheriou
            2 days ago













            1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can install iotop and run sudo iotop -o is a separate terminal window in order to see if there is any read and write activity.

            – sudodus
            2 days ago





            1. Please check again that all paths are correct: to the source, target and log. 2. Could it be the you can no longer read from the source? 3. Or is the problem, that you don't see any sign of life because the work is done silently? In this case you can install iotop and run sudo iotop -o is a separate terminal window in order to see if there is any read and write activity.

            – sudodus
            2 days ago











            0














            I have found that using a program like tar or cpio which allows you to specify a buffer size can speed up large copies. Apparently putting the buffers into userspace avoids some system memory thrashing which brings things to a crawl. Use a buffer size of at least 2M, which I found gave me a 3x speed improvement (larger may be even better, since for you, 3x is still only 3M /sec).






            share|improve this answer




























              0














              I have found that using a program like tar or cpio which allows you to specify a buffer size can speed up large copies. Apparently putting the buffers into userspace avoids some system memory thrashing which brings things to a crawl. Use a buffer size of at least 2M, which I found gave me a 3x speed improvement (larger may be even better, since for you, 3x is still only 3M /sec).






              share|improve this answer


























                0












                0








                0







                I have found that using a program like tar or cpio which allows you to specify a buffer size can speed up large copies. Apparently putting the buffers into userspace avoids some system memory thrashing which brings things to a crawl. Use a buffer size of at least 2M, which I found gave me a 3x speed improvement (larger may be even better, since for you, 3x is still only 3M /sec).






                share|improve this answer













                I have found that using a program like tar or cpio which allows you to specify a buffer size can speed up large copies. Apparently putting the buffers into userspace avoids some system memory thrashing which brings things to a crawl. Use a buffer size of at least 2M, which I found gave me a 3x speed improvement (larger may be even better, since for you, 3x is still only 3M /sec).







                share|improve this answer












                share|improve this answer



                share|improve this answer










                answered 2 days ago









                ubfan1ubfan1

                9,41641527




                9,41641527






















                    Mattia Eleftheriou is a new contributor. Be nice, and check out our Code of Conduct.










                    draft saved

                    draft discarded


















                    Mattia Eleftheriou is a new contributor. Be nice, and check out our Code of Conduct.













                    Mattia Eleftheriou is a new contributor. Be nice, and check out our Code of Conduct.












                    Mattia Eleftheriou is a new contributor. Be nice, and check out our Code of Conduct.
















                    Thanks for contributing an answer to Ask Ubuntu!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid



                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function () {
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2faskubuntu.com%2fquestions%2f1113235%2fvery-slow-copying-files-from-exfat-to-ntfs%23new-answer', 'question_page');
                    }
                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    Popular posts from this blog

                    Category:香港粉麵

                    List *all* the tuples!

                    Channel [V]