Maximum NC file size?

Question

I'm unable to view movie output from some large NC files and wondered if there was a maximum size HydroHub could handle (the ones it can't handle are ~10 GB). The same model settings produced viewable output when run for a shorter time period (~2 GB NC files). The error I get is "hn.hydrohub.G.F: No variable  found in NetCDF file _filepath_ Method: executeTask" when I try to view a movie in HydroHub (it is able to open the file).

Curtain and outflow files from the same run are viewable. Interestingly, if I click "Get Information" from one of the variables it shows only 394 values, while there should be 39416 values. So it seems like it stopped writing, even though the file size is large? Not sure. Any ideas/answers? Thanks.

Answer 1

Hi, there shouldn't be any NC file size limitations.

Is the file readable in Matlab or Python?

Can you send me the last 50 or so lines of the Main log file (inside the logs directory of your HydroHub workspace) and I'll see if I can track down what's happening.

Chris

Comments

I have not tried in Matlab or Python. Here's the giant error from the log, a whole lot of java callbacks:

2022-02-14 08:40:23,116 ERROR: No variable  found in NetCDF file C:/Users/mfoster/Documents/Projects/GreenLake/AEM/run/ncfiles/sheet_top.nc
hn.hydrohub.G.F: No variable  found in NetCDF file C:/Users/mfoster/Documents/Projects/GreenLake/AEM/run/ncfiles/sheet_top.nc
    at hn.A.t.A(Unknown Source)
    at hn.hydrohub.G.R.D.E(Unknown Source)
    at hn.hydrohub.G.R.D.I(Unknown Source)
    at hn.hydrohub.G.R.B.U(Unknown Source)
    at hn.hydrohub.G.R.C.A(Unknown Source)
    at hn.hydrohub.G.R.C.A(Unknown Source)
    at hn.hydrohub.G.R.C.I(Unknown Source)
    at hn.hydrohub.B.P.B.A.D.Õ(Unknown Source)
    at hn.hydrohub.B.P.B.A.D.LJ(Unknown Source)
    at hn.hydrohub.gui.E.P.C.A.<init>(Unknown Source)
    at hn.hydrohub.gui.E.P.C.D(Unknown Source)
    at hn.hydrohub.gui.E.P.F.A(Unknown Source)
    at hn.hydrohub.F.E.I.A.S.F.A(Unknown Source)
    at hn.hydrohub.F.H.actionPerformed(Unknown Source)
    at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2022)
    at javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2348)
    at javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:402)
    at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:259)
    at javax.swing.AbstractButton.doClick(AbstractButton.java:376)
    at javax.swing.plaf.basic.BasicMenuItemUI.doClick(BasicMenuItemUI.java:842)
    at javax.swing.plaf.basic.BasicMenuItemUI$Handler.mouseReleased(BasicMenuItemUI.java:886)
    at java.awt.AWTEventMulticaster.mouseReleased(AWTEventMulticaster.java:289)
    at java.awt.Component.processMouseEvent(Component.java:6533)
    at javax.swing.JComponent.processMouseEvent(JComponent.java:3324)
    at java.awt.Component.processEvent(Component.java:6298)
    at java.awt.Container.processEvent(Container.java:2237)
    at java.awt.Component.dispatchEventImpl(Component.java:4889)
    at java.awt.Container.dispatchEventImpl(Container.java:2295)
    at java.awt.Component.dispatchEvent(Component.java:4711)
    at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4889)
    at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4526)
    at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4467)
    at java.awt.Container.dispatchEventImpl(Container.java:2281)
    at java.awt.Window.dispatchEventImpl(Window.java:2746)
    at java.awt.Component.dispatchEvent(Component.java:4711)
    at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:758)
    at java.awt.EventQueue.access$500(EventQueue.java:97)
    at java.awt.EventQueue$3.run(EventQueue.java:709)
    at java.awt.EventQueue$3.run(EventQueue.java:703)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:80)
    at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:90)
    at java.awt.EventQueue$4.run(EventQueue.java:731)
    at java.awt.EventQueue$4.run(EventQueue.java:729)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:80)
    at java.awt.EventQueue.dispatchEvent(EventQueue.java:728)
    at java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:201)
    at java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:116)
    at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:105)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101)
    at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:93)
    at java.awt.EventDispatchThread.run(EventDispatchThread.java:82)

---

It looks like HydroHUb is not finding one of the variables.  Are you able to plot anything in the file?  The file may have been corrupted.

You could try opening the file in something like Panoply https://www.giss.nasa.gov/tools/panoply/