File Archive Haven

Dear SkyDrive (Sorry “OneDrive”) – You Are The Weakest Link – Goodbye!

skydrive

About a year ago I decided to change what I am doing to manage my data beyond using a backup solution.  At the time I considered all of the options very carefully and decided to settle on Microsoft.  Primarily, because they had a lower cost cloud solution.  And because they promise quality integration into the operating system.

A year later, I’ve decided I need to rearchitect my cloud solution.  After a year of issues, slow download speeds, poor indexing, and the application randomly wiping files and redownloading everything I’ve decided that SkyDrive (sorry “OneDrive”) just isn’t ready for public consumption.

My advice is to use this beta-gone-wild as it should be used … to store a few extra GB of information you have that is not important to you on a day-to-day basis.

At this point I need to caution:  This is a bit of a tongue and cheek article with some data added for reflection.  If you came here expecting a lot of positivity for Microsoft or shocking information, this may not be the article for you.

First, Why I Need Cloud Storage

I build a lot of software – in fact I have 25GB worth of projects on my computer across ~120,000 files.  I also have 5 devices that need quick synchronization between them and frequent backups. This is important because I know several developers that have had failed hard-drives with no backups, and ended up leaving development altogether.

In the past, I relied on a home computer system running a RAID 0 & RAID 5 split which has always worked well.  But this isn’t the best solution for synchronization of data – so I decided to add a cloud solution for the synchronization layer.  This also has the side-effect of adding data replication offsite which is a big plus as we had some massive floods here last year.

When I made the jump, I did a normal amount of research (looking at data for about a week) and decided to go with SkyDrive (as it was called at the time) based on articles and information mostly led by Microsoft.  Because I made the mistake most people make, and didn’t scratch below the surface, I forgot the one cardinal rule…  “Microsoft lies” (like most gigantic companies).

My systems that require data replication today:

  • My tablets (Windows Surface Pro, PlayBook, Nexus)
  • An amazing laptop for development (Clevo)
  • A 30TB home-built backup server (Storage System)
  • Mobile devices (Primarily my BlackBerry LE)
  • Several development VM’s in the cloud (including Linux, Mac and Windows)

What kind of data:

  • 15 different development IDE’s for project storage
  • Beta releases, Gold releases, and related marketing information
  • Architectural documents for shared projects
  • A rather large GitHub archive
  • Development resources (purchased artwork, music, sound effects, icons, etc)
  • An archive for important articles written for blogs (required for being paid for the work)

Once the data reaches the 30TB system, it automatically handles incremental backups using Areca.

Comparing Solutions

What I was looking for was a commercial level solution, that has a history of being tried and tested, with a company willing to stand by what they are selling.

DropBox:

  • Limitations
    • High cost (132/year)  Edit:  DropBox has revised their prices and sizes since posting
    • Smaller company means higher risk
  • Advantages
    • Solid tested performance (I was testing it at the time with 5GB +)
    • Well spoken of by larger companies
    • Better technical support (people actually talk to you)
    • Better architecture for handling files

SkyDrive:

  • Limitations
    • Made by Microsoft
      • This may seem harsh, but consider:
        • Large Company with Fragmented Support
        • Bad History with New & Inspired Products
        • “Get help from the community, not us” style support model.
  • Advantages
    • Integrated right into OS
    • Lower cost (50/year)
    • Solid tested performance as reported by users
    • Confirmed solid performance when I had a small SkyDrive (~50mb)

Box.Net:

  • Limitations
    • Less field tested
    • More Buggy, issues with mobile applications
    • Applications prone to crashing
    • Difficult to get support
  • Advantages
    • Free 50GB
    • OK performance, but not as consistent as DropBox (tested with 5GB +).

So there I was, with the evidence right in front of me.  Box.net was certainly attractive, but I didn’t want an experience that could be buggy.  Some companies like copy.com didn’t really have any big customers.  I also saw not many companies were willing to stand by Box.net, and mixed reports about performance.  This meant, no Box.net.

The high cost for Dropbox, 120/year, made me hesitate although my experience has been great.  At the time Microsoft was speaking very well about SkyDrive and advertising it as something great and to be bundled into Windows 8.1.  Reviews online seemed positive.  The online ordering process seemed easy.  And as 8.1 would eventually be used on my Tablet and PC (against my will I should caution) I decided to roll the dice and bought into SkyDrive.

As for upgrading from Windows 8 to Windows 8.1 … I held on as long as I could before I decided to make the change to finally get rid of the annoying popups after the registry solutions from Microsoft failed to work.  The upgrade also resulted in me losing all my applications and data (even though Microsoft said that wouldn’t happen).  Fortunately I didn’t trust what they told me and had backed up my applications and serial numbers.

Issues with SkyDrive

Well, I made the migration, and began the migration of my 25GB of data.

It is very important to understand, I have a fairly decent internet connection (100Mbps).  This was a result of me getting rid of Shaw, Telus and moving to an IP phone with Ooma, Internet with Nucleus and getting rid of cable altogether.

In addition, it is important to recognize there are 3 important components to cloud storage.  Upload speed.  Download speed.  And file synchronization.

Moving & Uploading Files to SkyDrive

I relocated all the files to my SkyDrive folder and allowed the application to upload.  I immediately found the upload was unbearably slow (i.e. 50kbps or less) and upon investigation realized it was caused by two issues:

  • They  limited the number of consecutive uploads to 1, which causes issues for lots of small files
  • They have a delay “timer” between uploads, this causes issues when you have many small files as the timer delay between files  is up-to 10 times longer than the upload time
  • The timer is also compounded by resynchronization periodically between files which can add hours
  • Slow ramp-up period (files upload slow and very slowly start increasing – up-to 10 minutes to reach a peak)
  • In addition, there appears to be bugs that make SkyDrive “die” and stop working – but everything looks OK on the surface

To resolve some of these issues I had to dig in my %appdata% folder under Microsoft\SkyDrive and make a  bunch of modifications to the configuration files.  Specifically increasing upload limits, download limits and other settings.

After the changes were made and the system restarted, I finally saw some better upload times.

Downloading from SkyDrive to my Tablet

My initial synchronization out to my devices was unbearably slow.  But I didn’t worry about it too much as I figured I would only have to do this once.  So I let the synchronization run for 3 days or so before it was completed.

Issues after Upgrading to Windows 8.1 : Online Files Only / Files Won’t Synchronize

This part was an absolute nightmare.

The initial releases had some ridiculous bugs with SkyDrive.  The application would not synchronize files – ever.  It would simply stay “downloading” and stuck on the first few files, and would never download.  Microsoft claimed to have patched this several times on their forums … but as of the day I switched, this issue was still persistent.  In addition they would not actually provide support just direct you to forum threads – typically with no Microsoft personnel in the threads at all.  It was a very frustrating period.

The issue with the above, is in 8.1 they removed any ability for you to monitor what is going on.  It provides no level of information including basic  synchronization information.  The Metro-side application actually misleads you, and misreports what it is doing.  And it randomly marks all your files as “online only”.

This means your device never will download the files.  Most applications error on your PC when it tries to access them.  And periodically it deletes all your 25GB of files and re-downloads them.  To this day, they still have bugs where every few reboots the files are marked as Online only (again).

Further Windows 8.1 Additional Complications

For example, when upgrading, it wiped out the 25GB of SkyDrive files.  Well, it actually just renamed the folder, and started all over again.

This caused it to re-download all 25GB.  It is a painful process, as “Synchronization” for SkyDrive takes 2-3 hours to “count” what files it is missing.  And the download had absolute horrible download speeds more on that part later.

Even on a fully synched drive, the synchronization period takes up-to an hour.

SkyDrive to OneDrive

When the brilliant folks at Microsoft decided to make an irrelevant change, I ignored it like most users.

Until it created a mess with files on several of my systems.  What the change did was create a \OneDrive folder, Migrate the files over, and then forcefully create a Symbolic link at \SkyDrive that cannot be removed while the application is installed.  This is a simple change in itself (and the right way to do things I suppose) however in case you didn’t know, Windows has all kinds of ongoing issues with Symbolic links.   Even in SkyDrive itself, Symbolic links cause problems. You would think they would avoid these – or at the very least, make them removable.

This folder change caused all kinds of problems with my systems.  And at one point the OS eeven managed to create a separate \SkyDrive folder which caused files to become disjointed from OneDrive.

Why I decided to change today

Today was enough.  I rebooted this morning, which caused SkyDrive to mark all files as available “online” only again against the settings I specified – subsequently deleting my 25GB and re-downloading all 25GB of files … again.

SkyDrive / OneDrive – Summary of Ongoing Issues to Anticipate

  • SkyDrive issues with Symbolic links
  • SkyDrive not downloading
  • SkyDrive not uploading
  • Very slow downloads
  • Very slow uploads
  • Poor UI with no feedback on Windows 8.1
  • Frequent crashing of the application
  • SkyDrive using single file uploading and downloading
  • Extremely slow “synchronization” component
  • Support is completely non-existent

Recommendation (Go-Forward Strategy)

I’ve performed significant testing on DropBox.  I’ve confirmed downloads seem to be reaching a much higher download speed limit (near maximum).  Which can be up-to 20x the speed I’m receiving from Microsoft (yes – you read that right) and is, at the very least, consistently at least 4x faster.  In addition it calculates synchronization requirements within minutes versus SkyDrive taking hours.  It also does not force symbolic links or generate errors with symbolic links.  And it doesn’t make a whole mess of your filesystem.

OneDrive may cost 1/3 as much – but with that you inherit a lot of problems.  Consider it the beta-user discount.  With their history of accessing and deleting peoples files on SkyDrive, the difficulty with removing OneDrive from Windows 8.1, and all the issues in this article up until now – I am willing to pay extra money to make all these problems go away.

If you are architecting backup solutions in the future – make absolutely SURE to skip SkyDrive / OneDrive integration at all costs.  Especially for anything with business requirements!

Speed Tests (My spidey senses are tingling, but this is probably what you care about and what Google sent you here for)

I just completed a series of Speed Tests, which are a bit difficult with the nature of their systems the way they are.  But side-by-side here is what we have based on actual data saved by the applications and with nothing else running.

Average Download Speeds (Testing 6 times)

  • A Few Minutes After Starting Transfers — Dropbox:  900kbps to 1,300kbps
  • A Few Minutes After Starting Transfers — SkyDrive:  50kbps to 650kbps
  • @2hrs — Dropbox:  3,300kbps to 3,650kbps
  • @2hrs — SkyDrive:  350 to 700kbps
  • @4hrs — Dropbox:  3,400kbps to 3,650kbps
  • @4hrs — SkyDrive:  300 to 550kbps

This is a major difference after running for a few hours.  Perhaps DropBox is just better suited to having servers in central Canada.

Upload tests show both SkyDrive and Dropbox are utilizing my maximum upload link of 500KB/sec.

Synctime Average With No New Files:

  • Dropox:  ~15 seconds
  • SkyDrive:  ~45 minutes

Synctime Average With Many New Files:

  • Dropox:  ~15 seconds
  • SkyDrive:  ~120 minutes

Data Downloaded After Timers Expired:

  • Dropbox:  Downloaded 414MB
  • Skydrive:  Downloaded 155MB

Dropbox is the clear winner.

Please note, it is currently midnight and I am tired and annoyed at Skydrive.  So I didn’t do any upload tests.  But I’m doubtful my 5Mbps uplink will find the threshold on either anyway.

Tips and tricks:

  • You can modify configuration files for SkyDrive in the %appdata%/Local/Microsoft/OneDrive to get better performance
  • If you watch the file sizes under your SkyDrive/OneDrive folder properties, you can see the real size as the folders download data
  • Windows 8.1 utilizes a synchronization executable for the Metro application only that provides limited information and customization, the desktop installer is not compatible with 8.1
  • You can’t reinstall the stand-alone SkyDrive application by any normal means on Windows 8.1
  • If you migrate to DropBox, it comes with a free Frogurt!  The frogurt is also cursed.

(45063)

20 thoughts on “Dear SkyDrive (Sorry “OneDrive”) – You Are The Weakest Link – Goodbye!

    1. Yeah, this isn’t WPCentral – you won’t get a lot of Microsoft love here when they drop the ball. As for the article, it was pretty bad, did a run through and cleaned up some of it. I wrote it at 2AM a long time ago after dealing with the whole mess. The important part is the download speed comparison.

  1. “interesting choice as Symbolic links cause problems with the OneDrive application.” Incorrect. Symlinks cause problems when they are inside the onedrive folder and pointing out. A symlink INTO the onedrive folder (what the app is managing) causes zero issues.

    1. Good clarification, however, this was not intended to be an explicit reference. That-is Windows OS has many known issues with Symbolic links (I’ve clarified it in the article). And it is interesting to me that they choose to force a symbolic link you cannot remove. I didn’t mean to say that the symbolic link to SkyDrive breaks itself on installation – I went ahead and clarified that above.

  2. My experience with Onedrive has been the same unfortunately. Files that won’t sync for no apparent reason and the Onedrive for business application crashes over and over again. I will probably leave it too.

    1. It was a hard decision. The price is right and Microsoft does have the ability to do it right if they want to. However. Since switching to dropbox – I have not had a single issue. And I find the links and downloads are much more mobile friendly than Box and especially Skydrive. And that matters to me too (a lot of my recipients are on mobile)

  3. I landed on this blog post after searching for OneDrive + Symbolic Links. Anyway, I’m a regular user of OneDrive I have 60Gb stored. Without any problem. The only issue I have seen was the problems uploading files. One time it reported that there was an upload but didn’t show any progress. I restarted the onedrive service and the upload continued. I think the mayor problem with OneDrive is that it doesn’t supports ReFS and I have my Storage Spaces raid formated with that. So I’m unable to use my larger volume to keep my files. I was looking into that option since I have 1Tb of storage now (come free with office 365). I also do software development but I don’t store code on a sync folder I prefer to use GitHub (private repo). Of course I don’t store my git database on onedrive it is already backup’d on github. I used to use Dropbox but then I moved to OneDrive when I upgraded to Win8. Good Luck

    1. Good information to know. It’s certainly possible part of my issue is simply load balancer related or location. Several times since posting this article (mindless rant I suppose!) I have retested the download,upload and sync speeds and found it to still be around the same. It could just be their servers are terrible in my area. I do keep files in github as well, I have a server that syncs it for me. The reason I never used github as the primary is I am selfish and I like to edit the code on my phone, tablet, laptop, work machine, and VM. With a cloud solution it just ‘syncs’ and I don’t have to deal with the whole github management. Or opening firewall ports into my home servers. I do like that it adds a second layer of protection (30 days of restore points for files) including my home data server which let’s me also restore the files to any point over a few years. With that said this method wouldn’t work at all if there is more than one developer. And it certainly isn’t the industry standard. So I do kind of get what I pay for with it 🙂

  4. Hi, very informative post. I use OneDrive to backup my DropBox… I was impressed to see OneDrive now has 1TB available for Office subscribers but it has taken 3 days to upload 30mins equivalent of DropBox data. Oh well.

  5. Same here … always problems with this damn application. No syn, slows system down , etc. We have a office 365 plan in our company but onedrive for business is a nightmare. I switch back to dropbox. Shame on you microsoft !

  6. Onedrive for business sucks! Yep I migrated to Onedrive for Business 2 weeks ago and its been a saga of freezing syncs, wiping caches manually, then it creates new folders. Just so much hassle. Bizarrely Onedrive (personal) is completely different its not driven by sharepoint and syncs very well for me. But no use for my business. Formerly I had Dropbox Pro and dropped it for the Office 365 package with MS Office 2013 and outlook exchange email and the !TB of data. I am v. happy with everything except for Onedrive which sucks big time. I thought Onedrive for business would give me amazing portability of Office apps and all my business docs across multiple devices. Sadly failed big style. Its back to dropbox or another solution which also gives me system backups.

  7. Thanks for this post. My experiece is similar, but I didn’t measure the actual times and speeds. This confirms for me that ‘you get what you pay for’. Now I can move to DropBox Pro knowing why it’s better than OneDrive (as part of Office 365 Home). Thanks.

  8. Sir: Thank you for your investment of time and detail with the issues of OneDrive (almost all of which I’ve truly experienced myself). I’m in the process of moving out of OneDrive because I just am not able to get over their (ridiculously) slow upload speeds. Don’t think that DropBox is the answer, either. In spite of their generous user settings, I’m still dissatisfied with their system control issues (it’s my system, not theirs).

  9. I was Googling for syncing multiple volumes with OneDrive and somehow landed here. I’m running OneDrive on OS X, and currently planning to backup more stuff with OneDrive, since Office 365 subscription now comes with unlimited OneDrive storage. Apparently my MBP hard drive isn’t unlimited and most of the huge video files I would like to sync to OneDrive live on external drives; that’s why I’m looking into syncing multiple volumes. I might end up coding my own solution with the REST API, though; the search proved to be futile 🙁 Speaking of upload speed, I also have something to report. My OneDrive client for OS X has more than once stuck on an upload speed of less than 50 kbps, and fail to sync the last several files (stuck forever). I only sync photos and videos to OneDrive so the speed is not caused by small files, and always failing to sync the last few files is certainly weird. That behavior, left unattended, can live up to weeks (with multiple reboots in between) before I wipe clean the folders I want to sync on the server side (very sad!) and do a clean reinstall of the client. Even after that the upload speed tops out at around 4 MB/s (I’m on a Gigabit Ethernet and the Google Drive client can upload at 20-30 MB/s; I can also upload at more than 10 MB/s from the OneDrive web interface). I used to believe OneDrive is only buggy on OS X since it’s built by Microsoft, but seeing this post, apparently I’m wrong… Btw, Dropbox is a great *sync* service, and I use it as one. Being a sync service, though, it must be constantly up and running, eating cycles, so I’m careful to only symlink into the Dropbox folder the folders that I really want to sync in real time. OneDrive (and also Google Drive, for that matter) are suboptimal for syncing, so I just use them as cheap online storage and backup solutions.

Leave a Reply

Your email address will not be published. Required fields are marked *

*

This site uses Akismet to reduce spam. Learn how your comment data is processed.