Autoplot Application (#{tag})

Script demos how multiple script editors can be started.

Autoplot attempts to allow plotting of data from many data sources, including remote CDF files and OpenDAP servers. Datasets are identified with URIs, and by the URI's extension, data are loaded into the internal data model. Data are then displayed by guessing the rendering method and axis ranges to provide a reasonable, useful view of the data. Data can then be additionally processed with other operations like smooth and FFT, and Jython scripting provides a capable programming environment.

This is the Autoplot v2019a branch. This is an update to the production version containing bugfixes and minor new features. Java 7 is now required. Java 8 will be required sometime soon.

Run with 4GB of memory (64-bit Java only): autoplot_4GB.jnlp

Single-jar version, autoplot.jar, can be run without network access and from the command line.

Mac DMG Release is available.

Bugfixes (2019-05-25 r23712):

• rfe681: support download of http://radiojove.org/archive/data/1556842548UT190501173508_HNRAO_1.spd. Thanks, Masafumi!
• 2159: new das2stream reader dropped the last record in test137 at U. Iowa.
• 2159: new das2stream reader would use DataSetBuilder, which would in some cases return a DDataSet where only 10% was utilized, causing memory problems.
• polar plot would result in NullPointerException if Z is not available for rank 1 X,Y,Z
• 2160: jyds script default timerange would reject.
• 2159: new das2stream reader reads in many 1-record joined data, wasting memory. Thanks, Darrelle!
• rfe677: display data on bundle of X,Y,Z didn't clip on Y. Thanks, Ivar!
• URI_Template's phasestart modifier was never implemented. Thanks, Bob!
• 2158: setItemAllLists( rank0, rank0, rank1) now reconciles the three properly. Thanks, Bill!

Older Bugfixes:

• 2155: automatically set digitizer "sorted" property so that pixel locations don't clobber each other.
• TITLE property was printed twice in ASCII export.
• 2133: bug in Datum.Long to TimeStruct, where leap seconds were handled incorrectly, was corrected. Thanks, Darrell!
• %{TIMERANGE} macro can convert back to orbit number. Thanks, Ivar!
• 2154: support assignment of fill to dataset, where fill is copied or translated to the dataset's fill value. Thanks, Ivar!
• bug with new --quiet switch with AutoplotDataServer corrected.
• 1670: check for weight=0 with value=NaN, some codes assumed weight*value was valid. Thanks, Ivar!
• 2148: shift-execute correctly brings up the parameters dialog in the script editor.
• 2148: .jy scripts now get lint to check for common mistakes, before just .jyds scripts did.
• check for duplicate entries in CDAWeb file-finding service. This is a bug they will fix as well.
• 2140: top and bottom painters are automatically antialiased and have their own graphics context to protect other parts of the plot.
• 2140: add support for DasPlot top and bottom decorators.
• 2147: data reduction with series renderer and small pixels would result in washed-out image.
• 2146: autolayout incorrectly reclaims room for TCAs, adding noise to vap loading. Thanks, Kris!
• doDataSetReduce of SeriesRenderer now reduces to 1/2 pixel, so that "1px" sized black dots appear black.
• performance improvements to the HugeScatterRenderer.
• 2145: avoid infinite loop in Events List when there are no events in the next intervals.
• corrections to other bugs with the HAPI client when caching was turned on.
• performance improvements with new Das2Stream reader, along minor bugs pointed out by Jenkins tests.
• clean up old script examples in https://svn.code.sf.net/p/autoplot/code/autoplot/trunk/Autoplot/src/scripts/
• 2143: HAPI client respects dataset time boundaries when caching is enabled.
• rebinner API now passes information about the Z axis so interpolation can be fixed.
• "polar" render type corrects units.

Features:

• toTimeDataSet reconciles the rank, allowing rank 0 and rank 1 inputs for the time components.
• rfe469: Axis nodes have "tickValues" property which allows tick spacing and location to be specified manually.
• rfe680: Expect utility included now to support driving other applications like FTP and IDL.

Less recent features:

• rfe677: redo the GUI for the display data dialog, so you can see and control the yclipping. Thanks, Ivar!
• rfe678: add mad function! Thanks, Ivar.
• PngWalkTool's write to animated gif and write to pdf file now have a button to copy the output filename to the clipboard.
• AutoplotDataServer has -q option to quiet informational messages on stderr. Thanks, Bob!
• file download now logs transfer rates to das2.filesystem.wfs at FINER.
• sftp support uses java property user.name to get the username by default, so two people can share .vaps with different .ssh keys.
• ImageVectorDataSetRenderer renamed to HugeScatterRebinner.
• Autoplot-based HAPI Server supports If-Modified-Since header.
• handle rank 1 with optimized loop in simpleRange.
• HAPI data source now caches binary transactions.
• Das2Streams are now read directly into QDataSet.
• DataSetBuilder can accept fields from DatumVector, for performance.
• imgscalr library added, which will provide faster thumbnails.
• polarToCartesian function and filter added.
• support Radio and Plasma Wave Group's GitLabs site with GitHubFileSystem.
• support U. Iowa GitLabs site with GitHubFileSystem.
• polar renderer supports x,y,z color scatter plot.
• new code reads Das2Streams directly into QDataSet.
• das2streams support x,y,z scatter. Clean up strange names in the das2stream parser.
• Renderer.render now takes Graphics2D object, instead of Graphics.
• API changes like removing monitor from render call will make scripting easier.

Known issues:

• see Source Forge
• Bugs often have a four-digit ID and can be reviewed with https://sourceforge.net/p/autoplot/bugs/<ID>/.
• Features typically have a three-digit ID and can be reviewed with https://sourceforge.net/p/autoplot/feature-requests/<ID>/.

This completes the feature set for the new production branch. No major features will be added before branching this version. A production branch will be started in a couple of weeks, and the "Start Autoplot" link at the top of autoplot.org will run this version. Feedback on the function and quality of this release is greatly appreciated!

Data is input from:

• ASCII files (.dat,.txt)
• CSV files (.csv)
• Binary files (.bin)
• CDF files(.cdf)
• Excel spread sheets (.xls)
• das2Streams (.d2s or .das2Stream)
• ViRBO's TSDS server
• CDAWeb data server (vap+cdaweb:)
• das2servers (vap+das2server:)
• QStreams (.qds), QDataSet on a das2Stream
• Plasma Wave Group das2 Server
• NetCDF files (.nc,.ncml)
• HDF5 files (.h5,.hdf5)
• DODs servers (.dds)
• Cluster Exchange Format files (.cef)
• Fits Format Files
• Images (.jpg, .png, .gif)
• Wav audio files (.wav)

This is not complete, and limitations include:

• Quantities of rank 3 dimensionality (e.g. flux(Time,Energy,pitch) are plotted by slicing.
• Quantities of rank 4 dimensionality (e.g. flux(Time,Energy,azimuth,sector) are plotted by slicing twice.

autoplot.org is the wiki website, and contains more information than this launch page.