Topics

Data wrangling oddity

 

Can someone explain this:

Yesterday I got to the hotel from a days shooting 4 x 64Gb SXS card in 29.97. The client has nicely supplied a new G tech USB C SSD and a G tech EV drive.  Everything went super fast with all 256Gb offloaded in about an hour.

I now offloading tonights material.  Everything is in exactly the same ports but its now saying one hour to transfer one card.   The difference is the card is 23.97 and one longish clip.  

Why does that make a difference?  Offloading with Shotput pro V6

Michael Sanders
London Based DP.

+ 44 (0) 7976 269818




sid firstframe.com
 

Did you use the exact same media cards as the day before? Were they reformatted before use on Day 2?

- Sid

SID LEVIN | Principal | DP | Editor
FirstFrame Inc - 978.501.0488


On Apr 18, 2018, at 4:08 PM, Michael Sanders <glowstars@...> wrote:

Can someone explain this:

Yesterday I got to the hotel from a days shooting 4 x 64Gb SXS card in 29.97. The client has nicely supplied a new G tech USB C SSD and a G tech EV drive.  Everything went super fast with all 256Gb offloaded in about an hour.

I now offloading tonights material.  Everything is in exactly the same ports but its now saying one hour to transfer one card.   The difference is the card is 23.97 and one longish clip.  

Why does that make a difference?  Offloading with Shotput pro V6

Michael Sanders
London Based DP.

+ 44 (0) 7976 269818




Ryan De Franco
 

Sometimes, particularly after a computer has been on for some time, it seems the USB ports can get “knocked down” to USB-2 speeds. A restart usually solves this, sometimes several, with multiple eject - remounts of the drives as part of the rinse cycle. Good luck,

Ryan De Franco
DoP, Canyonlands Utah for now... 

--

Glenn Lee Dicus
 

The first check is the hard drive. See what the transfer speed is going straight to your internal. If that checks out then if you have another external drive to test, see if it transfers ok.


My first fear would be that the external was about to fail.

Has it left your sight? Can you ensure that it was treated properly from one day to the next? I see some crazy things people do with them thinking they are a lot tougher than they actually are.

Glenn Lee Dicus
LA based Loader

 

@Sid Absolutely everything is the same right down to where the drives were plugged into the computer.  Only difference was we were shooting at 23.97 and yes cards were formatted.  

@Glenn the spinning Hd  was in my padded bag in the van.  Didn’t get dropped or knocked all day.

Michael

Michael J Sanders: Director of Photography 
  

Mobile: +44 (0) 7976 269818   
Linkline Diary: +44 (0)20 8426 2200

On 18 Apr 2018, at 22:19, sid firstframe.com <sid@...> wrote:

Did you use the exact same media cards as the day before? Were they reformatted before use on Day 2?

 

Apologies for the terse end.. producer wanted to start filming and I hit send by accident.

Thanks for all the input.  I’ll see how today’s go.


Michael

Michael J Sanders: Director of Photography 
  

Mobile: +44 (0) 7976 269818   
Linkline Diary: +44 (0)20 8426 2200

On 19 Apr 2018, at 07:19, Michael Sanders <glowstars@...> wrote:

@Sid Absolutely everything is the same right down to where the drives were plugged into the computer.  Only difference was we were shooting at 23.97 and yes cards were formatted.  

@Glenn the spinning Hd  was in my padded bag in the van.  Didn’t get dropped or knocked all day.

Michael

Michael J Sanders: Director of Photography 
  

Mobile: +44 (0) 7976 269818   
Linkline Diary: +44 (0)20 8426 2200

On 18 Apr 2018, at 22:19, sid firstframe.com <sid@...> wrote:

Did you use the exact same media cards as the day before? Were they reformatted before use on Day 2?

sid firstframe.com
 

I’ve only encountered this issue with corrupted files or an SSD card - whereby I stopped using it. 

- Sid

SID LEVIN | Principal | DP | Editor
FirstFrame Inc - 978.501.0488


On Apr 19, 2018, at 2:20 AM, Michael Sanders <glowstars@...> wrote:

@Sid Absolutely everything is the same right down to where the drives were plugged into the computer.  Only difference was we were shooting at 23.97 and yes cards were formatted.  

@Glenn the spinning Hd  was in my padded bag in the van.  Didn’t get dropped or knocked all day.

Michael

Michael J Sanders: Director of Photography 
  

Mobile: +44 (0) 7976 269818   
Linkline Diary: +44 (0)20 8426 2200

On 18 Apr 2018, at 22:19, sid firstframe.com <sid@...> wrote:

Did you use the exact same media cards as the day before? Were they reformatted before use on Day 2?

Eavan A
 

Blackmagic Speed Test app could be useful to test the read/write speeds.


Eavan Aiken
Editor | occasional wrangler

Jared Lorenz
 

Sometimes a bent/loose/dirty pin or jostled cable can cause this sort of thing. Check /eject/restart/test. Be wary of and check the disk too, as instructed by others.
Jared Lorenz
EPK | Steadicam | DIT



Rocco Schult
 

Sometimes, particularly after a computer has been on for some time, it seems the USB ports can get “knocked down” to USB-2 speeds. A restart usually solves this, sometimes several, with multiple eject - remounts of the drives as part of the rinse cycle. Good luck,
Just as Ryan pointed out: if the connection is USB, check it twice.
It can be multiple, from USB interface chips getting warm to connectors being fishy, dusty, not plugged all the way in (makes the immediate difference between USB3 and 2, talking about 1mm here!) etc.
The reboot and checking the connections physically is a good starting point.
Having blackmagick disk speed utility handy will give a good idea what your dealing with, but not why.
For the why, if we talk USB, check system connection, under Windows it is in the bottom right menubar with a USB symbol, use about this Mac and System report on Macs and select USB.
If the desired device shows only USB2 or something like ‚High speed‘ (which is 480Mbits only aka USB2), you know where you’re coming from.

Good luck.

rocco schult
out of the box | ACHT, Frankfurt

sameer shrivastava
 

Hi
 
 I assume you are using a Mac Book Pro or similar. 
please check /About this mac/system report/ USB and report
 
it should report correct drives with correct usb speed
 
Sameer Shrivastava
D.O.P/Aerial Cinematographer/ Colourist/Smoke Artist
Dir. @ Birdeye Movies
http://www.birdeyemovies.com/index.html
Phone +91 9820431618
 
 
 

On Thursday, April 19, 2018, 9:24:30 PM GMT+5:30, Jared Lorenz <jared@...> wrote:
 
 
Sometimes a bent/loose/dirty pin or jostled cable can cause this sort of thing. Check /eject/restart/test. Be wary of and check the disk too, as instructed by others.
Jared Lorenz
EPK | Steadicam | DIT
 

 

 

Thanks all so much.

Just started downloading today’s rushes and of course it’s all fine!!

Michael

Michael J Sanders: Director of Photography 
  

Mobile: +44 (0) 7976 269818   
Linkline Diary: +44 (0)20 8426 2200

On 19 Apr 2018, at 17:04, sameer shrivastava via Cml.News <ss2sameer=yahoo.com@...> wrote:

Hi
 
 I assume you are using a Mac Book Pro or similar. 
please check /About this mac/system report/ USB and report
 
it should report correct drives with correct usb speed
 
Sameer Shrivastava
D.O.P/Aerial Cinematographer/ Colourist/Smoke Artist
Dir. @ Birdeye Movies
Phone +91 9820431618
 
 
 
On Thursday, April 19, 2018, 9:24:30 PM GMT+5:30, Jared Lorenz <jared@...> wrote:
 
 
Sometimes a bent/loose/dirty pin or jostled cable can cause this sort of thing. Check /eject/restart/test. Be wary of and check the disk too, as instructed by others.
Jared Lorenz
EPK | Steadicam | DIT
 

 

James Marsden
 

Hi Michael
     This is quite common with a Mac, Either the card reader or the Hard Drive or the card reader has negotiated to the wrong as Ryan correctly suggested, I see it every so often, usually stopping the backup and rebooting will fix it, one way around it is to always use thunderbolt drives, for me it is usually the SBAC-30 or ASMX readers that are culprit, and to be clear it can happen between backups on a Mac that has not been turned off but maybe has gone to sleep but I tend to set the energy saver controls to never sleep and you will still see it, the change in frame rate is just a coincidence the back up will be unaware of it as it is all just data to that process, USB 3 is 5 megabits per second (mbps) which is actually 640 Mega Bytes per second (MBps ) though I never see more than around 400 to 420 MBps and USB 2 is 480 mpbs or 60 MBps but agian I never see much over 40 mbps, which as you can see is a speed reduction by a factor of 10.
    Good that you did have a spinning disk back up as well as the SSD as I don't recommend using just using just SSD's for backups as you are just transferring from one volatile NAND flash-based storage medium to another, and to be honest I try to avoid the G-TECH stuff since they are now all western digital based media inside which I find from experience to be both slower and less reliable than when they were part of Hitachi, so my standard now is 2 Sony Pro RAID drives, they have 7200 rpm Seagate media in and are shock mounted internally, using 2 of these and a Sonnet Echo as an SxS reader would eliminate this problem, though the Echo Pro can introduce som of its own due to the need for drivers from Sony for the.

But in short, it is a matter of turning it off and then on again, with maybe a pause in the middle.

Hope that helps

James Marsden
Digital Media Solutions
DIT, Camera, Data and Workflow consultant

07958580678

George Hupka
 

As others have have commented, a reboot usually fixes the problem.

I have been using Hedge lately for transfers, and haven't had any issues like this since I started using it...
--
----------
George Hupka
Director/DP
Saskatoon, Canada
Listmum, Cinematography Mailing List

Previous Topic Next Topic