Quakesim

New Account Creation Issues Resolved

2011-12-12T09:09:00.000-08:00

Problems with automated account creation have been fixed by a server restart.

QuakeSim Jira

2011-11-30T12:12:00.001-08:00

We have started using Jira to track tasks and bugs. See http://grids.ucs.indiana.edu:8080/jira/ for more information. Bugs can be reported and issues can be browsed anonymously. You can also create an account if you would like additional feedback.

Simplex and Disloc User Interface Updates

2011-09-13T13:44:00.000-07:00

We have made several updates to Disloc and Simplex:

The Simplex and Disloc portal interfaces now handle linked changes in fault parameters. For example, changing a project fault's latitude and longitude values will automatically update other connected parameters such as the length and strike.
Simplex now includes a "quick add" feature that allows you to paste in values for the faults and project origin. This is useful if you have a legacy Simplex problem and only know the Cartesian values for the faults.
Simplex now allows you to change your project temperature, number of iterations, and origin after the project has been created. This will also correctly update any project faults. Updates to observations are not currently supported, however.

Daily RDAHMM upgraded to use Google map API v3

2011-07-04T21:55:00.000-07:00

The daily RDAHMM web interfaces have been upgraded to use Google map API v3. A "QuakeSim" logo is also added to the bottom right corner of the map.

Simplex, Disloc Archived Data list delete bug fixed

2011-07-01T15:05:00.000-07:00

The bug preventing archived results from being deleted has been fixed.

Updates to Simplex

2011-06-20T11:57:00.000-07:00

Simplex, QuakeSim's deformation inversion tool, can take several minutes to run so we have added an email notification feature. Before you submit your job, provide an email address, and the portal will send you an email when Simplex completes.

Except for input files, your archived job data links for running jobs will be empty until the job finishes, so wait for the email before clicking.

Updates to daily RDAHMM web interface

2011-06-19T20:03:00.001-07:00

We did several updates to the daily RDAHMM web interface:

1. We combined the two portlet pages into one page, and the four separate pages into one other page. So now whenever we make some general changes to the web interface, we only need to modify the codes of 2 pages, compared with 6 pages previously.

2. The time series plots are not shown in the pop-up windows of the station markers now. A "View Time Series" button is added to the pop-up window, and when the user clicks it, the plots will be shown in a separate window. The size of the plotting component is set to cover the whole window so you can change its size by drag the window.

3. We include displacement data to the UNVACO results so the plots for UNVACO PBO and UNAVCO Nucleus now have two vertical axis - the left one shows the displacements and the right one shows the absolute value. The left and right axis of all plots are now lined up so all the line charts have the same length.

4. A station search function is added to both the portlets and the separate pages. In the portlets, when the user selects a different station in the drop-down list of station IDs, the corresponding pop-up window will open in the map so that the user can see where the station is. In the separate pages, a drop-down list of station IDs and a "Find Station" button is added under the "Get KML" button. The user can find a station by first choosing its ID from the drop-down list and then click "Find Station".

Daily RDAHMM service updated to include displacement data

2011-06-19T19:52:00.001-07:00

We have modified the daily RDAHMM service including the unavcotrans.py script to generate displacements data in NEU relative to a reference point for UNAVCO Nucleus and UNAVCO PBO stations.

We also removed some codes for generating a redundant copy of the XML result file.

UCERF Version 2.4 Faults Available for Deformation Tools

2011-05-25T11:39:00.000-07:00

UCERF 2.4 faults can now be imported into project using the forward and inverse deformation tools (Disloc and Simplex). All version 2 UCERF faults are available through the QuakeTables database.

Two updates to daily RDAHMM

2011-05-13T23:05:00.000-07:00

1. We combined the static and dynamic state change number vs. time plot in the daily RDAHMM portlets and separate pages. Users can now get the plot for a bounded area shown with the dygraph component.

2. We changed the function of KML generation so that now it can generate a KML for more than 2 years without causing an OutOfMemory error. It also includes a QuakeSim logo in the generated KMZ. Getting a KMZ for a period longer than 2 years is not encouraged, though, because it will contain too much information for Google Earth to efficiently handle.

Updates to Disloc

2011-05-10T11:09:00.000-07:00

The Disloc user interface has been significantly revised to make it easier to use. These changes also keep it in sync with the anonymous version available from quakesim.org
.

Updated Layouts

2011-05-06T08:43:00.000-07:00

We have updated tool layouts. The tab "Deformation Analysis" has been retitled "Deprecated Tools" and moved further to the right. The tab "Revised Deformation Analysis" is now "Deformation Analysis Tools".

Separate web pages added for daily RDAHMM

2011-05-03T13:44:00.000-07:00

We created separate .jsp pages for daily RDAHMM, which can be directly accessed without going to the QuakeSim computational portal:

http://gf4.ucs.indiana.edu:8080/DailyRDAHMM-portlet/DailyRdahmm_sopac_sep.jsp (for SOPAC GLOBK data)

http://gf4.ucs.indiana.edu:8080/DailyRDAHMM-portlet/DailyRdahmm_jpl_sep.jsp (for JPL GIPSY data)

http://gf4.ucs.indiana.edu:8080/DailyRDAHMM-portlet/DailyRdahmm_unavcoNucleus_sep.jsp (for UNAVCO Nucleus data)

http://gf4.ucs.indiana.edu:8080/DailyRDAHMM-portlet/DailyRdahmm_unavcoPbo_sep.jsp (for UNAVCO Pbo data)

These pages are embed into iframes of the QuakeSim public portal at http://quakesim.org/portal/timeseries. The pages are almost the same as the portlet pages except for two modifications:

1. we removed the section for showing a station's detailed analysis results from the right side of the page, and added a tab to the pop-up window of a station's marker to show these results;

2. we adjusted their sizes so that they fit well into the iframes.

We also created a "small" version of the separate page for JPL GIPSY data at http://gf4.ucs.indiana.edu:8080/DailyRDAHMM-portlet/DailyRdahmmJplSmall.jsp, and this page is embed in the "Station Monitor" tab of the public portal at http://quakesim.org/home.

"Today" button in daily RDAHMM portlet changed

2011-05-03T13:41:00.000-07:00

We changed the text of the "Today" button in the daily RDAHMM portlet pages to "Latest", and modified its functionality so that clicking the button now sets the selected date to the latest date when data is available for any station, instead of "today".

Another minor change to the daily RDAHMM portlets is that we modified the layout of the gridsphere portal so that the portlet for JPL instead of SOPAC is shown by default.

pages and services added for Japan data analysis

2011-05-02T21:52:00.000-07:00

We added web pages and services to facilitate the RDAHMM analysis to the GEONET RINEX GPS data provided by the Geospatial Information Authority (GSI) of Japan. The overall structure and the interfaces are similar to daily RDAHMM, and the most significant difference is that the GEONET data are collected every 30 minutes, so the pages and services are both tuned to accommodate this type of interval. The pages are here:

http://gf4.ucs.indiana.edu:8080/AriaRDAHMMTest/AriaRdahmm.jsp (for data in LLH)

http://gf13.ucs.indiana.edu/AriaRDAHMMEst/AriaRdahmmEst.jsp (for data in NEU)

http://gf13.ucs.indiana.edu/AriaRDAHMMEst/AriaRdahmmEstMar26.jsp (for data in NEU dated up to Mar 26th).

The third page shows data picked out from an original data set that was collected at a rate of 30 seconds. I.e., the original data were timestamped with "00:00:00, 00:00:30, 00:01:00, ...", and only data timestamped with "00:00:00, 00:30:00, 01:00:00, ..." are picked out and then processed by RDAHMM and presented in the web pages.

RDAHMM executale and evaluation process updated

2011-05-02T21:40:00.000-07:00

We updated the RDAHMM executable to correct two bugs: one that makes the binary to generate the same .maxval and .minval files when building models and the other that could lead to "0"s in the state sequence files because of overflow.

We also updated the evaluation process so that if "0"s are seen in the resulted .Q file, we rerun the evaluation step with an extra "-addstate" parameter so that data points that could not be classified will be assigned a state number of "6". The plotting swf is also updated so that it plots data points with a state number of 6 in yellow.

Scripts for getting LLH UNAVCO data updated

2011-05-02T20:55:00.001-07:00

The height dimension of the LLH data for the UNAVCO data source was not right, which Jay has pointed out. We updated the scripts for getting UNAVCO data so that they directly return the right data in LLH and we don't need an extra step to convert the results into LLH.

Scripts for getting UNAVCO data updated

2011-05-02T20:10:00.000-07:00

The scripts for getting UNAVCO data in daily RDAHMM service are updated to get the data for specified starting and ending dates. They were not working correctly previously because the tools used by the scripts don't return data that exactly match the given dates. They just return the whole data set for a given station if the data set has a overlap with the given time period. Marie added a filtering step in the scripts to cut off the data that fall out of the given date range.

Deep directory structure in daily RDAHMM KMZ files are removed

2011-05-02T19:31:00.000-07:00

The KMZ files generated by the daily RDAHMM result service used to have a deep directory structure because of the way "zip" is used. We have changed this so that the KMZ file now only contains a KML file. We also changed the file name extension from .kml.zip to .kmz so that users can directly open it with Google Earth. We plan to further change this in the future so that the KMZ will contain one top level KML and a set of sub level KMLs.

Disloc, Simplex, and GeoFEST Faults Corrected

2011-04-27T07:13:00.000-07:00

We determined that the fault width values provided through the map interface to the QuakeTables fault database were incorrectly calculated. The underlying KML has been updated. This only applies to CGS 1996 and 2002 faults that were selected from the map interface, not to user-provided faults.

State change number plot in daily RDAHMM changed

2011-04-19T20:40:00.000-07:00

We changed the state change number plot in daily RDAHMM portlets to use bars instead of lines, as shown in the following figure. The static png plots are also changed to use bars, and the plot for a bounded area is shown in a separate tab in stead of a new window.

For the Dygraph javascripts, we use the following options to achieve this effect:

{colors:['#007FFF'],
strokeWidth:0.7,
pixelsPerXLabel:50,
rightGap:2,
stepPlot:true,
fillGraph:true,
fillAlpha:0.8}

For the gnuplot scripts, we use the following two lines:

set style fill solid 1.0
plot "FILE" using 1:2 with boxes linetype 3

Daily RDAHMM updated to use LLH

2011-04-19T15:44:00.000-07:00

We have changed the daily RDAHMM service and portlets so that they analyze and display LLH (longitude, latitude, height) time series data, instead of the NEU(north, east, up) data. We use the "Proj.4" application (http://trac.osgeo.org/proj/) to convert NEU data to LLH.

RDAHMM problems resolved, portal upgraded

2011-04-11T11:10:00.001-07:00

Previously reported RDAHMM problems were resolved on March 15. Disloc, Simplex, and RDAHMM interfaces have also undergone several revisions and improvements.

RDAHMM service problems

2011-01-31T07:43:00.001-08:00

The servers hosting the RDAHMM service are undergoing emergency maintenance, so RDAHMM is capabilities are not available.

Portal Account Resets

2010-11-17T09:31:00.001-08:00

The portal has been rebuilt, and you must re-enable your existing accounts. All project data is saved. Just request a "new" account with the same name as your old account.

Support for multiple date format added to daily RDAHMM portlet

2010-11-12T20:03:00.000-08:00

We changed the daily RDAHMM portlet so that users can use various format to specify dates in the input boxes, including 'yyyy-mm-dd', 'yyyy/MM/dd', 'MM/dd/yyyy', 'MMMM dd, yyyy', or 'MMM dd, yyyy'.

New state change number vs. time plot component added to daily RDAHMM portlet

2010-11-12T17:02:00.000-08:00

We Changed the daily RDAHMM portlet to use the "DyGraph" Javascript component to draw the state change number vs. time plot. In this plot users can select data points by moving the mouse around the plot, and can zoom in to a specific time section by selecting an area, and zoom out by double click.

Disloc InSAR Plotting Service Updated

2010-09-17T12:58:00.000-07:00

We have updated this service to match the color table used by UAVSAR.

New plotting component added to daily RDAHMM

2010-09-02T13:37:00.000-07:00

We have added a new swf plotting component to the daily RDAHMM portlet, as shown in the following picture. Compared to the old plots, this new plotting component has the following advantages:

1. better point and line connections;
2. zoom-in and zoom-out in time scale;
3. slide-though along time axis;

Portal URL Updated

2010-09-02T11:06:00.000-07:00

The portal URL is now http://portal.quakesim.org. This will be the permanent portal URL from now on and will make future host upgrades less disruptive. The portal is still hosted on gridfarm003, but the old URL will give Google map key warnings. The old host, gw11.quarry.iu.teragrid.org, has been deprecated and should not be used.

Disable Google map recenter function in daily RDAHMM

2010-07-21T14:34:00.000-07:00

In response to portal users' requests, we have disabled the "automatic recenter function" of Google map in the daily RDAHMM portlet. The trick turns out to be a "internally used" feature of the GMarker.openInfoWindowHtml() function, which is not included in the official online documents:

marker.openInfoWindowHtml(htmlStr, {suppressMapPan:true});

KML service in daily RDAHMM portlet extended for date ranges

2010-07-21T14:20:00.000-07:00

The KML generating function in daily RDAHMM portlet is extended to support date ranges, instead of single dates. The resulted KML will have a "Folder" element which contains a series of "Document" elements corresponding to each date within that date range. Each "Document" is marked with a "TimeSpan" element, so that the whole KML can be played as an animation along the time axis.

Corresponding modifications are applied to the daily RDAHMM result service.

Due to problems with current implementation, the KML function can only support a not-too-long date range, typically shorter than two years. We will try different implementation methods to solve this problem.

New png plotting set-ups in daily RDAHMM service

2010-07-21T14:11:00.000-07:00

In daily RDAHMM service, we modified some of the gnuplot scripts so that the png pictures are plotted in the following manner:

(1) All points are first connected with light gray lines;
(2) On top of the gray lines, continuous sections with the same state are plotted with lines of colors corresponding to the state;
(3) On top of the colored lines, all points are plotted with "+"-shaped points of colors corresponding to the states of each point.

De-trend and De-noise options added to daily RDAHMM service

2010-07-21T14:01:00.000-07:00

We added de-trend and de-noise functions to the daily RDAHMM service, and these features can be turned on and off by modifying the property files of the service. Since de-noise is done on the output data of de-trend, these options can only be turned on or off together -- that is, the input data is only de-trended and de-noised in a sequence when both options are on; otherwise neither is done. We'll separate them in future work.

New URL for QuakeSim

2010-07-13T06:40:00.000-07:00

The new URL for QuakeSim is http://gridfarm003.ucs.indiana.edu/gridsphere/. If you have an account on the old server, you simply need to create a new account with the same name on the new server. All your projects will be preserved. Contact us if you have any problems.

Disloc Movie for New Users

2010-07-11T18:51:00.000-07:00

Click this link to see a tutorial movie for using Disloc: http://gw11.quarry.iu.teragrid.org:8080/Disloc3/disloc3.htm.

Disloc KML Generation Services Update

2010-06-01T13:08:00.001-07:00

The Disloc service has been upgraded to fix a bug that limited it to (approximately) 80x80 grid sizes. We have tested with 150x150 grids.

Portal Hosting Issues

2010-05-28T14:55:00.000-07:00

We have experienced issues with the portal hosting server that may temporarily corrupt the user database. These are fully recovered from backups, and we have added additional logging and monitoring, but please report any problems.

Disloc InSAR Plotting Feature Added

2010-04-20T09:23:00.000-07:00

You can now make InSAR-like fringe plots of Disloc output files. This is done automatically for all new disloc runs and can also be applied to older disloc problems.

QuakeSim DB Crash and Rebuild

2010-04-12T07:30:00.000-07:00

The user database crashed on April 11, and the entire portal needed to be rebuilt. All user project data has been preserved, but you will need to recreate your account through the automatic account creation process using the same user name as before. Please contact us if you have any problems.

KML generating function added to daily RDAHMM result service

2010-03-30T14:26:00.000-07:00

We added a new function to the daily RDAHMM result service, which can generate a KML file describing the states of all stations for a specified date. The file can be opened and shown successfully with Google Earth, but Google map has problems when showing the interactive plots.

A "Get KML For This Day" button is added to the daily RDAHMM portlet, which when clicked will call the daily RDAHMM result service to create a KML for the selected date, and show the content in a new window.

Simplex3 Project Copying

2010-03-02T12:50:00.001-08:00

You can now copy projects in the Simplex3 portlet (one of the new "revised" collection).

Revised Disloc, Simplex, and GeoFEST portlets

2010-03-02T12:49:00.001-08:00

These have been added under the tab "Revised Deformation Analysis". The new portlets use the revised version of the QuakeTables database.

Major changes to daily RDAHMM service

2010-02-18T15:44:00.000-08:00

We spent a lot of time re-writing a major part of the daily RDAHMM service, and here are some important changes:

1. A large amount of dirty codes are cleared up. The DailyRDAHMMService class is replaced with a new DailyRDAHMMStation class, which performs all functions DailyRDAHMMService used to complete, but with better flexibility and extendability. Some old functions of the DailyRDAHMMThread class are also moved to the DailyRDAHMMStation class.

2. The process of modeling and evaluation for each station are changed to the following sequences:
(1) Check if a model already exists. If so, count the non-duplicated data in the model input -- if more than 200, skip the whole modeling process and go to step (5); otherwise delete the model files and continue with step (2).

(2) Choose intial start and end date for modeling input. First read the startDate saved in jplDates.txt or sopacDates.txt.
if startDate < 2006-09-30 and startDate + 1year <= 2006-09-30 then
endDate = 2006-09-30
else
if startDate + 1year <= "today" then
endDate = startDate + 1year
else
set endDate to null
give up the modeling process and return failure
endif
endif

(3) Adjust endDate.
while number of non-duplicated data in the model input of [startDate, endDate] is less than 200 do
If endDate > "today" then
set endDate to null
give up the modeling process and return failure
endif
endDate += 1year
endwhile

(4) Build the model.
Fill the model input with duplicated data, and build the model.

(5) Do evaluation.
Read the lastDate of model input from the model input file;
Query for input for [lastDate+1, "today"];
Append the queried input to the model input, and fill the combined input with duplicated data;
Do evaluation on the filled input.

3. Two sub-elements are added to each "station" element in the XML file of the station list: one "modelStartDate" sub-element and one "modelEndDate" sub-element. Since these dates are different for different context groups, we now have two different station list files for the two context groups (sopacGlobk and jplGipsy) analyzed.

4. The service is now scheduled to run every seven days, since we got informed that the GPS data are updated in a weekly manner. Maybe we should change the service name to "weekly RDAHMM service"?

Interactive plots added to daily RDAHMM portlet

2010-02-18T15:25:00.000-08:00

We added interactive plots to the daily RDAHMM portlet at http://gw11.quarry.iu.teragrid.org/gridsphere/gridsphere?cid=DailyRDAHMM-Portlet. Now if you click on a station marker on the Google Map in the portlet, the pop-up window will show an interactive plot component, where you can view the station's GPS data plot in different time scales, from the most recent one week to all time.

The implementation of this interactive plot is an embedded flash object which does the plotting job given two links as arguments: one for the .raw file of the station's GPS data input, and one for the .Q file of the station's all-time state change sequence. This flash object is made by Sidd and Josh in PTI -- many thanks to their help with QuakeSim.

Some times the flash object could load slowly due to the network activity of the machine hosting it.

QuakeSim Down January 6

2010-01-05T08:04:00.000-08:00

The data center that hosts the QuakeSim application server is undergoing a power upgrade, so some of the job submission capabilities are not available. We expect the machines to be powered up after 3:00 pm Eastern.

QuakeSim servers updated to port 80

2009-10-08T12:28:00.000-07:00

The gw11.quarry.iu.teragrid.org portal server and gf13.ucs.indiana.edu http server have been updated to use port 80 instead of 8080, so that access to the portal is not blocked by any firewalls. This update is completed by running httpd on the same servers and having httpd redirect requests to URL patterns corresponding to QuakeSim portal and resources to the QuakeSim tomcat servers. Therefore, the tomcat servers are still running on port 8080, and services which used to access the web services through 8080 can still work.

The realtime RDAHMM service configurations are modified so that the service now stores all results to directories under tomcat's "webapps" on gf13. The realtime RDAHMM portlet is also modified so that the results are now accessed from gf13 instead of gf14.

XYZ changed to NEU in daily and realtime RDAHMM

2009-10-08T12:24:00.000-07:00

The daily and realtime RDAHMM portlets have been updated so that the "Current X", "Current Y", "Current Z" tags are changed to "North", "East" and "Up".

Modifications to the evaluation process of daily RDAHMM

2009-09-07T15:44:00.000-07:00

Previously, the evaluation process of daily RDAHMM only takes a station's GPS data from 2006-10-01 to "today" as input.

We now extend the evaluation input to include all of a station's GPS data since 1994-01-01; i.e., including input data in the modeling process. For any specific station, the state change sequence in the evaluation process for the modeling time section is expected to be the same as the sequence in its modeling result. Further, if any input data is missing between the last "data-available date" of the modeling time section and the first "data-available date" in the evaluation time section, data duplicated from the last "data-available date" of the modeling time section is used to fill the "data-missing" section.

Tooltips Added to Simplex, Disloc, and GeoFEST

2009-08-17T13:49:00.001-07:00

GeoFEST, Disloc, and Simplex fault parameter forms now have tool tips to explain the parameters. GeoFEST layer parameters also have tool tips.

Modifications to daily RDAHMM service for supporting JPL data source

2009-04-12T21:19:00.000-07:00

We have modified the daily RDAHMM service in the following way so that other data sources can be supported in a flexible way:

1. We run one service process for each data source;

2. Corresponding to different data sources, different directories will be used to save the daily RDAHMM analysis results. Besides, different arguments should be used for querying the input GPS data for different data sources;

3. On start up, a service process will receive the path to a property file as an argument. This file contains information such as the data source, pre-processing treatment, directory for saving the results, and GRWS query arguments for this process. The process will analyze the property file, and thus do analysis to the specified data source, using the right corresponding query arguments, pre-processing treatment, and output directory.

Support for JPL data source added to Daily RDAHMM portlet

2009-04-12T21:18:00.001-07:00

Support for JPL data source has been added to daily RDAHMM portlet. We added a separate jsp page, DailyRdahmm_jpl.jsp, to show the results of JPL data source, and added a navigation rule in the portal configuration file, faces-conf.xml, to navigate betweent the pages for SOPAC data source and JPL data source. Now there is a link on each page pointing to the other page, so the user can click this link to view results for the other data source. Updates have been applied to the server at gw11.quarry.iu.teragrid.org:

http://gw11.quarry.iu.teragrid.org:8080/gridsphere/gridsphere

Daily RDAHMM portlet modified corresponding to the video service

2009-03-23T13:16:00.000-07:00

We have modified the daily RDAHMM portlet so that it now links to a video file made by the daily RDAHMM video service, which will always be in mp4 format.

Daily RDAHMM Video Web Service Completed

2009-03-16T21:29:00.001-07:00

And here's the design document:

To make daily RDAHMM movies with h264 video format, which is the most portable format across Linux, Windows and Mac platforms, we decide to create a DailyRDAHMMVideoService web service sitting on a machine where everything is OK for making h264 videos, and answering the requests from DailyRDAHMMService, and returning links to videos newly created.

Pre-requisite:
mencoder installed with support for x264 options
mp4BOX installed

So far the only machine that satisfies these requirements is Xiaoming's machine with IP address 156.56.104.161.

Requirements for DailyRDAHMMVideoService web service:
We call DailyRDAHMMVideoService the "video service" for short. This service is supposed to support the creation of daily RDAHMM movies for different data sources (SOPAC, JPL, etc.), and different pre-process treatment methods to input data (with vs. without missing data treatment). Given a data source, a treatment method, a URL to the analysis result XML file of that data souce, and a pair of start and end date, the video service will create a movie for the period between the start and end date, according to the result XML file specified in that URL, and return a URL to the created video. More specificly, the video service provides a web service method "String makeVideo(String dataSource, String preProcTreat, String resultURL, String startDate, String endDate)", which makes the requested video, and returns the URL string of the video.

Design Issues:
1. Directory seperation. Since we want to support different data sets and input treatment methods, the analysis results and corresponding map pictures for these different parameters will be different, so we need to separate the directories for different parameter combinations. Let denote the top directory for storing the pictures and temporary video files, we use [picDir]/[dataSouce]/[preProcTreat] for different parameters.

2. Quick response. To respond quickly to the client, we apply asynchronous process to its request. First, the video service will check if the parameters are valid, e.g., whether the given data source and treatment methods are supported. If not, a URL pointing to another method of the video service, "String getErrorMsg(int msgNum)" will be returned to the client, so that when the client opens that URL, a proper error message will be returned. If the parameters are valid, a URL will be constructed immediately according to these parameters and returned to the client, before the video is actually created. That is, we assume that there will be no errors in the process of creating the video. After enough debugging, we think this will not cause very serious problems: anyway, putting an invalid URL on the portal in rare cases will not be the end of the world.

3. Requests buffering. In order to answer multiple requests asynchronously in a short time, we buffer these results in a list, and use a separate thread to process them. This separate thread is sleeping when there is no request to process, and will be waken up for new requests.

4. Avoiding redundant work. To avoid creating video frames for any period for multiple times, we save the start date (which will always be 1994-01-01) and end date of the last video created. Upon every new request, the video service will check its start and end date. If these dates falls in between the start and end date of the last video, we just return the URL for the last video. A new video will be created only if the end date is later than the end date of the last video, since all starting dates are supposed to be no earlier than 1994-01-01. Besides, if the month number of the given end date minus 2 is later than the month number of the historical video, the historical video is updated and extended to the month according to the given month number minus 2. For example, if the end date of the historical video is 2008-07-31, and the end date of the requested video is 2008-11-22, then the historical video will be updated to 2008-09-30 first, and then the new video is created based on the new historical video.

Compilation problem with x264 enabled mencoder

2009-02-11T00:05:00.000-08:00

In order to make a daily RDAHMM movie with fps=5 that is compatible to every platform and player, we tried to encode the video with several different types of formats, and found that the only qualified format is h264. However, in order to make mencoder work with h264, we need to recompile it with x264 option, as well as the support of x264 package. We found it very hard to make sure the compilation can complete on any server, because of lack of x264 support on the machine, or because the wrong version of x264.

So we are now trying to separate the video making function from the Daily RDAHMM Service, so that it can just be deployed to a server where everything is OK, and answer requests from Daily RDAHMM Service from everywhere. This way we also need only one copy of all the map pictures and historical video, and the update of the historical video will also be easier to manage.

Daily RDAHMM Result Service added to svn control

2009-02-11T00:00:00.001-08:00

The Daily RDAHMM Service has been added to the code depository of QuakeSim2. A new directory DailyRDAHMMResultService is added to the ExecutionServices directory, and the service can be built and deployed with maven commands from the top QuakeSim2 directory.

Since Daily RDAHMM Result Service is deployed with Axis2, we also added a axis2.tar.gz under the portal_deploy directory, which will be deployed after tomcat is deployed. The Daily RDAHMM Result Service is deployed under the "services" directory of axis2.

For sake of consistency with previous deployment configurations, the Daily RDAHMM Result Service will also be built with maven scripts in pom.xml, and a directory will be copied to the webapps directory of tomcat. But this is not necessary: this directory will not be the running service. We might be able to deploy all other services to axis2 in the future, so that we don't need to copy them to "webapps" directly any more.

Test DailyRdahmm Result Service set up

2008-12-02T20:40:00.000-08:00

We have set up a test web service at http://156.56.104.161:8080/axis2/services/DailyRdahmmResultService?wsdl to calculate markers' colors for a given date. Also added is a "please wait" window to the portlet while the page is waiting for results from the service. Calling the web service to calculate the colors is actually faster than using managed bean, because now we don't have to refresh the page. The test page is located at http://156.56.104.161:8080/gridsphere/gridsphere, log in with empty user name and password.

We'll update this to gwll and svn after performance measure is done.

Daily RDAHMM video updated

2008-11-01T01:08:00.000-07:00

Because of the changes of our treatment to missing data sections, and correction of several bugs, the historical results of Daily RDAHMM are also different from previously. So we just made a new movie for the whole time since 1994 based on the new results. The new video can be accessed from the portal at http://gw11.quarry.iu.teragrid.org:8080/gridsphere/gridsphere

Modifications to DailyRDAHMM missing data treatment

2008-11-01T01:07:00.001-07:00

We did the following modifications to the treatment of missing data in DailyRDAHMM:

1. For the input data, if the dates used for getting the input is 1994-01-01 to 2006-09-30, and we only get data for 1995-10-03 to 2006-8-22, then we will only fill those time sections between 1995-10-03 and 2006-8-22, and leave the gaps before and after as they are, in order to avoid the distortion to results;

2. For the big flat file that contains input for all stations, we use NaNs to fill all missing lines.

Treatment to missing data corrected in daily RDAHMM analysis

2008-10-07T22:22:00.001-07:00

A serious error of daily RDAHMM analysis has been corrected, concerning the way we treat the missing input data of stations. Previously we do nothing about the missing data but recording them, which may lead to incorrect RDAHMM results because the Hidden Markov Model assumes an even distribution of data across time. So now we correct this error by inserting "fake data lines" in to the missing-data time sections, which are duplicated from the available data at a most recent time relative to the missing-data time sections.

After this correction, the total number of stations with state changes dropped significantly (from around 100 on average to less than 30) during for the time from 2006 to 2008. Whether this new result is reasonable still needs verification.

Result Aggregator added to real-time RDAHMM service

2008-10-07T22:14:00.000-07:00

A new component, real-time RDAHMM results aggregator, is added in to the real-time RDAHMM service. This aggregator connects to the service through NaradaBrokering, receives messages containing the real-time RDAHMM analysis results from all the seven networks, and aggregates these results and save them into a single .xml file, so that the portlet can show the results by accessing this file.

One problem is the large amount of results. Some stations came across as many as 800+ state changes within a 4-hour test run. So we just save one day's results in this file temporarily.

Daily RDAHMM porlet files updated

2008-09-16T20:37:00.000-07:00

The big DailyRdahmm.jsp file is now split into three files: DailyRdahmm.jsp and two other utility javascripts, NmapAPI.js and dateUtil.js.

QuakeTables Access Problems

2008-09-12T15:21:00.001-07:00

The QuakeTables portlets are IFrames that loads URLs like http://gf19.ucs.indiana.edu:9898/public/public.jsp and others (you can pop these out in most browsers by right-clicking).

Some departmental firewalls only allow HTTP traffic over ports 80, 8080, 443, or 8443. If you get a timeout message like the one below, the problem may be that you can't reach the QuakeTables web server's port 9898.

Disloc Plot Portlet Disabled

2008-09-08T06:46:00.001-07:00

This portlet was not compatible with the reformatted KML output, so it has been temporarily disabled. Plots can still be made through Google Maps or Google Earth.

Map Interfaces for Fault DB

2008-09-07T11:24:00.001-07:00

Disloc, Simplex, and GeoFEST now have Google map interfaces that allow you to select faults interactively.

All updates to daily and real-time RDAHMM portlets are availabel at

2008-09-06T13:33:00.000-07:00

http://gw11.quarry.iu.teragrid.org:8080/gridsphere/gridsphere

Update to real-time RDAHMM portlet

2008-09-06T13:29:00.001-07:00

We have changed the coloring plan of markers in the real-time RDAHMM portlet, so that now the colors describes the state change information about each station, rather than which network they belong to. Now we have three different colors: red for state change within last 2 hours, yellow for state change within last 1 day, and green for no state change within last 1 day.

We use red for last 2 hours because there is a lag between the time stamp of the real-time data and the "current" time when the data is received. For example, at 14:10pm, we might just receive a station's gps data with a time stamp of 13:05. Therefore, the evaluation results of a station always show its state change information of an hour ago or so.

In order to expose the state change information to the portlet, the real-time RDAHMM service saves this information for each network in a separate file in the same directory as the plots, so that the portlet can retrieve them with URLs.

To show which network each station belongs to, we add a hint tag to the marker of each station, witch shows its name and the name of its network.

Video making added to Daily RDAHMM

2008-09-06T13:28:00.000-07:00

We have integrated the video making function to daily RDAHMM service and portlets.
The service will now create a new thread to make a video of the whole time period after doing RDAHMM analysis on all stations, and add an xml element into the result xml file, which gives a URL of the newly created video.

The portlet will show a link to this video, right below the link to the trace file of each day's number of stations with state changes.

Plot of state change numbers added to daily RDAHMM

2008-09-06T13:27:00.000-07:00

A new plot function is added to the daily RDAHMM service. After doing RDAHMM analysis on all stations everyday, the service will draw a plot to display the variation of the number of stations with state changes through the whole time from 1994-1-1 to "today". We added new shell and gnuplot scripts to do this, and the service will generate a file containing the trace of the state change numbers as the input for these scripts.

On the daily RDAHMM portlet, a new tab is added to show this plot, as well as a link to the trace file, which contains the detailed information about each day's number of stations with state changes.

GeoFEST Portlets Fixed and Other Updates

2008-08-27T12:12:00.000-07:00

The problems with the GeoFEST portlet updates have been fixed, and these portlets have been turned on. The updates are to resolve a build problem. The functionality should be the same. One problem is that the old GeoFEST outputs have been removed. The project database was not overwritten, so you can recreate outputs. However, the mesh and geofest results before today should be deleted.

I have also added a "News" (really, an RSS client) portlet to the guest layout. This can also be added to the logged in display. By default it displays the feed of this blog, but it can be edited to show other feeds.

GeoFEST Portlets Temporarily Unavailable

2008-08-26T12:22:00.000-07:00

The GeoFEST portlets have been temporarily disabled while we upgrade them.

Fault DB Portlets Updated

2008-08-26T12:20:00.000-07:00

Two additional interfaces to the QuakeTables Fault DB have been added:

A portlet for downloading InSAR images, and
A portlet for getting KML representations of the faults.

Portal Updates to Use New QuakeTables DB

2008-08-25T15:46:00.000-07:00

Simplex, GeoFEST, and Disloc2 portlets have all been updated to connect to the QuakeTables database and Web service on gf19. This server is more stable than the older gf2, but the service and data should otherwise be the same.

Simplex updates

2008-08-11T16:16:00.000-07:00

Two updates to Simplex:

The portlet was updated to show old projects in reverse time order (most recent is first).
Bug in the KML plotting of output was fixed. East and North stations were swapped, so arrows pointed in the wrong direction.

Disloc Executable Changes

2008-08-10T08:02:00.000-07:00

Many output formats to 8.3f (decided that f was more appropriate than e; don't see much point getting precision below nearest meter).

Made to correct rounding problem in output file that produces different results for (0.0,0.0) and (0.0,-0.0).

QuakeSim Updates

2008-08-10T07:53:00.000-07:00

Updates to portal:

Layouts updated. Disloc2 promoted to "Deformation Analysis" tab. Old disloc and meshgen portlets moved to "Obsolete Portlets" tab.
Updated map centers of various GPS and RDAHMM portlets.
Disloc2 scatter points can now be deleted.
Disloc2 maps use updated KML service that correctly styles faults and points.
Grid input points as well as scatter input points can now be viewed before submitting disloc.
RealTimeRDAHMM portlet updated to use the new infrastructrue.

Updates to services:

KML Service updated to do a better job scaling arrows and to correctly style arrows and faults.
Disloc service updated to use corrected version of disloc executable.
RealTimeRDAHMM services now classify real time data against trained data sets.