Broadband Stations:

• Background
• Data Quality Control
• Data Retrieval SLM (Spyder; Kermit)
• Data Retrieval MPH, BLO
• Data Retrieval UTMT, UALR
• Data Retrieval FVM, PVMO, PBMO (Kermit)
• Data Retrieval OLIL, SIUC, USIN
• Addresses

• SLU Earthworm System

• CNMSN Earthquake Location Programs

Background

http://www.eas.slu.edu/Earthquake_Center/NM/

The data files in /cnmsn/SLM/BHZ.D are in SEED format. SEED names are given as:
/cnmsn/SLM/BHZ.D/{STA}.{NETWORK}.{COMP}.D.{YEAR}.{J-DAY} , i.e.,

SLM.NM.BHZ.D.2005.142.0000.

The real-time data is written to an active file on wiggles or the remote Sparc. At the end of the day the active file is renamed for the station, network, channel and date, as shown above.

The same directory structure applies to the other stations. The files remain in this directory for about a month, and then removed after they are archived to /net/taumsauk/r/2005/{J-DAY}.

We want to merge Quanterra data streams into a 24 hour miniseed file. We will archive the BH and LH channels for all stations, with the exception of OLIL, SIUC and USIN, that record addtional BL, HH, HL and LL channels. If there are data gaps, we will need to determine whether or not we can retrieve the the data. In some cases, we will need to login to the remote Sparcs and retrieve the day files from that system. And in other cases, we will need to go directly to the Quanterra digitizer to retrieve the data. In the case of OLIL, SIUC and USIN, we will only be able to retrieve day files if they rest on the sparc at the site. There will be times when we cannot retrieve the missiing data.

Programs such as sdrsplit and qmerge are used to manipulate the data stream further. Scripts automate the process of retrieving data and later, merging and renaming the data files.

Several tasks are performed daily for each stations' data. For archiving purposes, a complete 24-hour day file is created. If there are any gaps in the data, steps are taken to retrieve the missing gaps, if possible, so as to have the most complete day file as possible. These files are then moved to /net/taumsauk/r/2005/{J-DAY}, where the files are archived and will eventually be forwarded to IRIS.

Programs and scripts used to manipulate the SEED data will be discussed in detail.

Back to top

Data Quality Control

from an X window, log in to wiggles
ssh -X wiggles;
move to /seis/rbh/STAGING and run the script NMakeDay : This script invokes the program qmerge (see manual) which merges yesterday's and the previous day's data streams stored in /cnmsn/{STA}/{COMP.D} and merges them into a 24-hour seed file.

To get a complete day for May 22, i.e., May 22, 2005 from 00:00:00 to 23:59:99, run:

NMakeDay 142

Change directory to SLM/WORK.SLM.142 to view the output files.
The seed file SLM.NM.BHZ.D.2005.142 and the *err file, containing the output from qmerge -n SLM.NM.BHZ.D.2005.142 are found here. The same directory structure applies to the other stations. Check the *err files to make sure the data is complete, that there are no gaps. For example:

more SLM.NM.BHN.D.2005.142.err

produces:
SLM BHN: rate=20 (2005.142 00:00:00.0398 to 2005.143 00:00:00.0405) : 1728000 points, 0.6 msec correction, (min,max,max_step = 0.0,0.6,0.0 msec)

This is a good way to check if the day's data is complete. It reads that the BHN file contains data from 2005.142 00:00:00.0398 to 2005.143 00:00:00.0405, a 24 hour day. It contains 1728000 points: 864000 seconds (24 hours) x 20 samples/seconds. It also contains clock error information.

A gap in data stream may look something like:

SLM.NM.BHE. rate=20 (2005.142 00:00:00.0104 to 2005.142 07:18:17.1608) : 525943 points, 0.4 msec correction, (min,max,max_step = 0.0,0.4,0.2 msec)
SLM.NM.BHE. rate=20 (2005.142 11:33:49.6608 to 2005.143 00:00:00.0110) : 895407 points, 0.2 msec correction, (min,max,max_step = 0.0,0.2,0.2 msec)

(this is the output from qmerge -n SLM.NM.BHE.D.2005.142). This indicates that there is a data gap for this channel from approximately 07:00 to 12:00. You will need to retrieve this data, if possible.

If you have a data gap, run

qlog /cnmsn/STA/LOG.L/*2005.???.* | pg

This lets you look at the log files and check for information regarding time gaps. Page through the file to the time the outage is indicated. #ERR or #MSG flags will indicate a system error and no data will be retrievable during that time. If there is no idication of system errors, then we should be able to retrieve the data and merge the data streams to complete the day files. Refer to the Data Retrieval Sections for a particular station.

Sometimes, you will find that qmerge cannot open a data file. The program complains that it can't read the header. Go to the station's parent directory (/cnmsn/SLM/BHE.D) and run the program msfix on the seed file. Now you can run qmerge on the seed file, though there will now be a gap in the data where msfix read past the bad header. Run qlog and proceed as above.

cd /cnmsn/SLM/BHE.D
msfix SLM.NM.BHE.D.2004.142.0001
qmerge -n SLM.NM.BHE.D.2004.142.0001

If all the SLM.NM.{COMP}.D.2005.142.err files show complete days, i.e., day 142, 00:00:00 thru 143 00:00:00, then the files are ready to be archived.

Next, move all the *err files and all the seed files to /net/taumsauk/r/2005/{JDAY}
/seis/rbh/STAGING/netmove JDAY is a script that will move the data, or you can move the data manually:

mv * /net/taumsauk/r/2005/142
cd ../
rmdir WORK.SLM.142

* These stations will contain additional channel data. When you run the script NMakeDay it will produce BH, BL, HH, HL, LH and LL channels. These channels get moved to the archive directory along with the others.

Back to top

Data Retrieval: SLM (Kermit)

To retrieve SLM data:

logon to wiggles
login as spyder
su - spyder
passwd: xxxxxxxx (same as seismic)
cd to directory that you want to store the data in:
cd /cnmsn/SLM
type: kermit

C-Kermit> setmanual2
C-Kermit> con
C-Kermit> at (OK)
C-Kermit> atdt 9773127
login as seed
passwd: xxxx

..............................................................

QUANTERRA SCREEN

Command? K BH?

UTC starting date for VBB data:
yy/mm/dd hh:mm:ss
? 02/11/09 00:00:00

UTC ending date for VBB data:
yy/mm/dd hh:mm:ss
? 02/11/09 04:00:00

...search interval 2005/11/09 00:00:00 - 2005/11/09 04:00:00

1431 total records selected.

...creating local file

....writing local file

...creating archive file "CB021109.A00"
BHN-11/08 23:59+ , BHE-11/08 23:59+ , BHN-11/09 00:01....

"will start sending in...escape back to kermit ( CTRL\C ) and type receive "

CTRL\C

..............................................................

C-Kermit> receive

Data transmission begins. This could take a while, so if running overnite, lock the terminal that you're working on.

When finished, return to kermit :

CNTRL\C
C-Kermit> quit

Back to top

Data Retrieval: MPH, BLO

First, on wiggles , login to the remote machine as seismic ; use a secure shell login:

MPH: ssh tgpmph.ceri.memphis.edu -l seismic or
BLO (tgpblo.geology.indiana.edu)
passwd: xxxxxxxx

cd /cnmsn/MPH/BHZ.D (same directory structure as wiggles )

ls will list active file (current day file) and maybe the missing day file, i.e.,
MPH.NM.BHZ.D.2005.142.0000

scp MPH.NM.BHZ.D.2005.142.0000 wiggles.eas.slu.edu:/cnmsn/MPH/BHZ.D

If the day file is not there, or you need to retrieve small gaps, you can now use kermit to retrieve data from the Quanterra and send to the remote Sparc. From there it will be scp'd to wiggles.

Move to /cnmsn/MPH, where you'll want the files written. Type:

kermit (wait for prompt)
C-Kermit> con

k MPH.BH? (kermit transmission and channel name)
from: YY/MM/DD 00:00:00
to: YY/MM/DD 12:00:00 (repeat for the next 12 hours worth of data)

Type:

CTRL\C (return to kermit)
C-Kermit> receive

Return to kermit

CTRL\C
C-Kermit> con

When finished:

CTRL\C (return to kermit)
C-Kermit> quit

ls

scp cb020522.a00 wiggles.eas.slu.edu:/cnmsn/MPH
scp cb020522.m00 wiggles.eas.slu.edu:/cnmsn/MPH ...

On the remote Sparc:

Remove the cb020522.a00 cb020522.m00 ... files from the Sparc

CNTRL D (logout)

Merge and archive the files.

Back to top

Data Retrieval: UTMT, UALR

There is a script that telnets to UTMT and UALR and then ftp's the archive files over automatically. The script name is grab. A copy of the contents can be viewed here.

The directory /cnsmn/STA is where the archive files will be written to. You may get all the bh(bh\?) channels or the lh(lh\?) channels.

logon to wiggles (as seismic):

su - seismic
passwd: xxxxxxxx

UTMT
grab tgputmt.utm.edu lh\? 01/09/05,00:00:00 01/09/05,05:00:00 /cnmsn/UTMT/grab.log /cnmsn/UTMT

UALR*
grab tgpualr.uasys.edu lh\? 01/09/05,00:00:00 01/09/05,05:00:00 /cnmsn/UALR/grab.log /cnmsn/UALR

***************************

 SYNTAX
    grab [seed mask] [date1] [date2] [logfile] [ftp directory]

 ARGUMENTS:
   (1) seednames mask for RETRIEVE
   (2) date1   /*according to ultra-sheer software convention */
   (3) date2
   (4) complete path name of log file
   (5) complete path name of directory to place file (ftp)

The automation process may stop working at some point. For a description of the procedure to manually retrieve UTMT data, GO.

* UALR:
If an entire day file did not come over, you could first log in to the remote Sparc, as seismic:

ssh ualrbbs.ualr.edu -l seismic
cd /cnmsn/UALR/LHZ.D
scp UALR.NM.LHZ.D.2005.142.0000 wiggles.eas.slu.edu:/cnmsn/UALR/LHZ.D
CNTRL D (do not remove any files from this remote sparc!)