Skip to content

DASK for computationally expensive tasks #18

@wwieder

Description

@wwieder

@jhamman can you help with providing an example for how to use DASK to handle computationally expensive jobs. I got the for loop to calculated SVD in the script below (on my fork), but it's pretty slow for a single variable and single model. Is there a slick way to use DASK to speed this up?

notebook also available in /home/wwieder/python/ctsm_py/notebooks/.

https://github.com/wwieder/ctsm_py/blob/master/notebooks/MonthlySVD.ipynb
P.S., if the notebook renders can you find out why it's printing so much output to the screen?

Finally, also good to mask out grids w/ zero GPP (e.g. Antarctic)?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions