iraf.net

Hi all,
I've been attempting to use the mscred package to process some mosaiced data from the SOAR Optical Images (SOI). I've been encountering a series of errors that have me rather puzzled, and I was hoping that you might be able to help.
To process these data, I first need to put them through a script provided by the instrument operators for SOI data specically that basically mosaics the data and prepares it for processing (and I believe also applies an overscan and trimming operation). After applying this script to all data (bias, flat, science), I then move on to the mosaic processing.
I attempt to use ccdproc to then first process the bias images (should just combine them), and encounter the first error: 'ERROR: Input and output lists do not match'
The paramaters for ccdproc are:

PACKAGE = mscred
TASK = ccdproc

images = List of Mosaic CCD images to process
(output = ) List of output processed images
(bpmasks= ) List of output bad pixel masks
(ccdtype= ) CCD image type to process
(noproc = no) List processing steps only?

(xtalkco= no) Apply crosstalk correction?
(fixpix = no) Apply bad pixel mask correction?
(oversca= no) Apply overscan strip correction?
(trim = no) Trim the image?
(zerocor= no) Apply zero level correction?
(darkcor= no) Apply dark count correction?
(flatcor= no) Apply flat field correction?
(sflatco= no) Apply sky flat field correction?
(split = no) Use split images during processing?
(merge = yes) Merge amplifiers from same CCD?

(xtalkfi= ) Crosstalk file
(fixfile= ) List of bad pixel masks
(saturat= INDEF) Saturated pixel threshold
(sgrow = 0) Saturated pixel grow radius
(bleed = INDEF) Bleed pixel threshold
(btrail = 20) Bleed trail minimum length
(bgrow = 0) Bleed pixel grow radius
(biassec= ) Overscan strip image section
(trimsec= ) Trim data section
(zero = Mast_ZERO.fits) List of zero level calibration images
(dark = ) List of dark count calibration images
(flat = ) List of flat field images
(sflat = ) List of secondary flat field images
(minrepl= 1.) Minimum flat field value

(interac= no) Fit overscan interactively?
(functio= minmax) Fitting function
(order = 1) Number of polynomial terms or spline pieces
(sample = *) Sample points to fit
(naverag= 1) Number of sample points to combine
(mode = ql)

Using d_trace to get as much information as possible, the input and first and last part of the output look like:
mscred\$this->_split2($m[0]) ccdproc soar.025.fits,soar.026.fits,soar.027.fits,soar.028.fits,soar.029.fits,soar.030.fits,soar.031.fits output=Mast_ZERO2.fits
----- task cl - line 2 ( ) -----
2 167+5: call ccdproc
2 172+31: pushconst `soar.025.fits,soar.026.fits,soar.027.fits,soar.028.fits,soar.029.fits,soar.030.fits,soar.031.fits'
2 203+4: posargset 0
2 207+10: pushconst `Mast_ZERO2.fits'
2 217+5: indirabsset output
2 222+3: exec
----- exec script ccdproc (mscsrc$ccdproc.cl) - line 2 -----
----- task ccdproc - line 61 ( ) -----
61 228+5: call cache
1: CALL cache

*******************
. (***SASHA: LINES REMOVED ****)
********************

----- exec external task sections - line 109 -----
sections \$this->_split2($m[0]) $\nimages="Mast_ZERO2.fits"\noption="root"\n
nimages=7\nmode="ql"\n$nargs=1\n
--------------------------------
----- task sections - line 24 ( ) -----
24 11182+6: pushconst 1
24 11188+5: assign nimages
24 11193+3: end
----- task sections - line 25 ( ) -----
25 11182+4: call bye
24: CALL bye
25 11186+3: exec
----- exec builtin bye : line 25 -----
109 1257+6: call joinlines
25: CALL joinlines
109 1263+5: pushparam cal1
109 1268+4: posargset 0
109 1272+8: pushconst `STDIN'
109 1280+4: posargset 1
109 1284+5: pushparam cal2
109 1289+5: absargset output
109 1294+7: pushconst ` '
109 1301+5: absargset delim
109 1306+7: pushconst `-'
109 1313+5: absargset missing
110 1318+6: pushconst 161
110 1324+6: absargset maxchars
110 1330+6: pushconst no
110 1336+6: absargset shortest
110 1342+6: pushconst no
110 1348+5: absargset verbose
110 1353+6: getpipe
110 1359+3: redirin
110 1362+3: exec
----- exec external task joinlines - line 110 -----
joinlines < $\nlist1="tmp$ccdproc813fcR"\nlist2="STDIN"\n
output="tmp$ccdproc813fcS"\ndelim=" "\nmissing="-"\n
maxchars=161\nshortest=no\nverbose=no\nmode="ql"\n$nargs=2\n
--------------------------------
----- task joinlines - line 26 ( ) -----
26 11182+4: call bye
26: CALL bye
26 11186+3: exec
----- exec builtin bye : line 26 -----
110 1365+4: rmpipes 1
111 1369+5: call delete
27: CALL delete
111 1374+5: pushparam cal1
111 1379+4: posargset 0
111 1383+6: pushconst no
111 1389+5: absargset verify
111 1394+9: pushconst `dev$null'
111 1403+3: allredir
111 1406+3: exec
----- exec external task delete - line 112 -----
delete > $ 5\$this->_split2($m[0]) $\nfiles="tmp$ccdproc813fcR"\nverify=no\n
default_action=yes\nallversions=yes\nsubfiles=yes\nmode="ql"\n
$nargs=1\n
--------------------------------
27 11182+4: call bye
27 11186+3: exec
112 1409+8: pushparam sections.nimages
112 1417+6: pushconst 0
112 1423+3: gt
112 1426+8: pushparam sections.nimages
112 1434+5: pushparam nimages
112 1439+3: ne
112 1442+3: and
112 1445+4: biff +77
113 1449+5: call delete
29: CALL delete
113 1454+5: pushparam cal2
113 1459+4: posargset 0
113 1463+6: pushconst no
113 1469+5: absargset verify
113 1474+9: pushconst `dev$null'
113 1483+3: allredir
113 1486+3: exec
----- exec external task delete - line 114 -----
delete \$this->_split2($m[0]) $ 5\$this->_split2($m[0]) $\nfiles="tmp$ccdproc813fcS"\nverify=no\n
default_action=yes\nallversions=yes\nsubfiles=yes\nmode="ql"\n
$nargs=1\n
--------------------------------
28 11182+4: call bye
28 11186+3: exec
114 1489+5: call error
31: CALL error
114 1494+6: pushconst 1
114 1500+4: posargset 0
114 1504+15: pushconst `Input and output lists do not match'
114 1519+4: posargset 1
114 1523+3: exec
----- exec builtin error : line 116 -----
ERROR: Input and output lists do not match
cl_error: abort=1 beep=1 trace=1 flpr=1
cl_error: code=1 do_err=1 errtype=1/1 task='cl'

So that's error number 1 (it's come up before when trying to use ccdproc on other data sets; please let me know if you need anymore information).

Using zerocombine instead of ccdproc, I can get the combination to work. So on to the flat combining.

If I attempt to use ccdproc to get the flats to combine, I get a result similar to that above. If I instead use flatcombine, I get my second error: 'ERROR: Bad extension version range list' Again, this is an error that I've seen pop up before, but one that I've never understood.
The parameters for ccdproc when I call flatcombine are the same as above, but with zerocor=yes
The parameters for flat combine are as follows:

PACKAGE = mscred
TASK = flatcombine

input = List of flat field images to combine
(output = MAST_W12FLAT) Output flat field root name
(combine= average) Type of combine operation
(reject = avsigclip) Type of rejection
(ccdtype= ) CCD image type to combine
(process= yes) Process images before combining?
(subsets= no) Combine images by subset parameter?
(delete = no) Delete input images after combining?
(scale = mode) Image scaling
(statsec= ) Image section for computing statistics
(nlow = 1) minmax: Number of low pixels to reject
(nhigh = 1) minmax: Number of high pixels to reject
(nkeep = 1) Minimum to keep (pos) or maximum to reject (neg)
(mclip = yes) Use median in sigma clipping algorithms?
(lsigma = 3.) Lower sigma clipping factor
(hsigma = 3.) Upper sigma clipping factor
(rdnoise= 0.) ccdclip: CCD readout noise (electrons)
(gain = 1.) ccdclip: CCD gain (electrons/DN)
(snoise = 0.) ccdclip: Sensitivity noise (fraction)
(pclip = -0.5) pclip: Percentile clipping parameter
(blank = 1.) Value if there are no pixels
(mode = ql)

If I again get the script to give me the entire call sequence and just pull the first and last 100 or so lines, the result looks like this:

mscred\$this->_split2($m[0]) flatcombine soar.035.fits,soar.036.fits,soar.037.fits,soar.038.fits,soar.039.fits output=MAST_W12FLAT_b.fits
----- task cl - line 2 ( ) -----
2 167+6: call flatcombine
2 173+24: pushconst `soar.035.fits,soar.036.fits,soar.037.fits,soar.038.fits,soar.039.fits'
2 197+4: posargset 0
2 201+11: pushconst `MAST_W12FLAT_b.fits'
2 212+5: indirabsset output
2 217+3: exec
----- exec script flatcombine (mccdred$flatcombine.cl) - line 2 -----
----- task flatcombine - line 33 ( ) -----
33 223+5: pushparam input
33 228+4: assign ims
34 232+5: pushparam output
34 237+4: assign out
37 241+5: pushparam process
37 246+6: pushconst yes
37 252+3: eq
37 255+4: biff +61
38 259+5: call ccdproc
1: CALL ccdproc

*******************
. (***SASHA: LINES REMOVED ****)
********************

16: CALL mscextensions
462 10463+7: pushconst `@'
462 10470+5: pushparam outlist
462 10475+3: concat
462 10478+4: posargset 0
462 10482+8: pushconst `file'
462 10490+5: absargset output
462 10495+7: pushconst `0-'
462 10502+5: absargset index
462 10507+7: pushconst `'
462 10514+5: absargset extname
463 10519+7: pushconst `'
463 10526+5: absargset extver
463 10531+6: pushconst no
463 10537+5: absargset lindex
463 10542+6: pushconst yes
463 10548+5: absargset lname
463 10553+6: pushconst no
463 10559+5: absargset lver
463 10564+7: pushconst `'
463 10571+6: absargset ikparams
464 10577+5: pushparam extlist
464 10582+3: redir
464 10585+3: exec
----- exec external task mscextensions - line 466 -----
----- connect to mscbin$x_mscred.e -----
mscextensions \$this->_split2($m[0]) $\ninput="@tmp$ccdproc813hcC"\noutput="file"\n
index="0-"\nextname=""\nextver=""\nlindex=no\nlname=yes\n
lver=no\ndataless=no\nikparams=""\nnimages=4\nimext=yes\n
mode="ql"\n$nargs=1\n
--------------------------------
----- task mscextensions - line 95 ( ) -----
95 11715+6: pushconst 4
95 11721+5: assign nimages
95 11726+3: end
----- task mscextensions - line 96 ( ) -----
96 11715+6: pushconst yes
96 11721+5: assign imext
96 11726+3: end
----- task mscextensions - line 97 ( ) -----
97 11715+4: call bye
15: CALL bye
97 11719+3: exec
----- exec builtin bye : line 97 -----
466 10588+9: pushparam mscextensions.nimages
466 10597+6: pushconst 0
466 10603+3: gt
466 10606+4: biff +734
467 10610+9: pushparam mscextensions.nimages
467 10619+6: pushconst 1
467 10625+3: gt
467 10628+4: biff +552
468 10632+5: call type
16: CALL type
468 10637+5: pushparam extlist
468 10642+4: posargset 0
468 10646+4: addpipe
468 10650+3: redir
468 10653+3: exec
----- exec external task type - line 468 -----
type \$this->_split2($m[0]) $\ninput_files="tmp$ccdproc813hcD"\nmap_cc=yes\n
device="terminal"\nmode="ql"\n$nargs=1\n
--------------------------------
----- task type - line 98 ( ) -----
98 11715+4: call bye
17: CALL bye
98 11719+3: exec
----- exec builtin bye : line 98 -----
468 10656+5: call scan
18: CALL scan
468 10661+11: pushconst `ccdproc.tmpfname'
468 10672+4: indirposset 0
468 10676+5: getpipe
468 10681+3: redirin
468 10684+3: exec
----- exec builtin scan : line 468 -----
468 10687+4: rmpipes 1
469 10691+5: call hselect
19: CALL hselect
469 10696+6: pushparam tmpfname
469 10702+4: posargset 0
469 10706+8: pushconst `ccdmean'
469 10714+4: posargset 1
469 10718+6: pushconst yes
469 10724+4: posargset 2
469 10728+4: addpipe
469 10732+3: redir
469 10735+3: exec
----- exec external task hselect - line 469 -----
hselect \$this->_split2($m[0]) $\nimages="tmp$ccdproc813hcN[im1]"\n
fields="ccdmean"\nexpr="yes"\nmissing="INDEF"\nmode="ql"\n
$nargs=3\n
--------------------------------
----- task hselect - line 99 ( ) -----
99 11715+5: call error
20: CALL error
99 11720+6: pushconst 1
99 11726+4: posargset 0
99 11730+15: pushconst `Bad extension version range list'
99 11745+4: posargset 1
99 11749+3: exec
----- exec builtin error : line 99 -----
----- disconnect bin$x_images.e -----
ERROR: Bad extension version range list
cl_error: abort=1 beep=1 trace=1 flpr=1
cl_error: code=1 do_err=1 errtype=1/1 task='ccdproc'
"hselect (tmpfname, "ccdmean", yes) | scan (x)"
line 469: mscsrc$ccdproc.cl
called as: `ccdproc (images=soar.035.fits,soar.036.fits,soar.037.fits,soar.038.fits,soar.039.fits, output=, bpmasks=, ccdtype=, noproc=no)'
"ccdproc (ims, output="", bpmasks="", ccdtype=ccdtype, noproc=no)"
line 38: mccdred$flatcombine.cl
called as: `flatcombine (input=soar.035.fits,soar.036.fits,soar.037.fits,soar.038.fits,soar.039.fits, output=MAST_W12FLAT_b.fits)'
mscred\$this->_split2($m[0])

So there's error number 2.

Again, please let me know if you need any help. These are not the only errors that I've encountered while trying to perform mscred image processing, but they'll be a good place to start I think.

Thanks in advance for the help; I really do appreciate it

Sasha

In the case of the first error message, I think you are confusing the CCDPROC task with the *COMBINE task functionality, i.e.you have seven input images and one output image name where the CCDPROC task is expecting to process *each* input image into a unique output image name. Something like IMCOMBINE is what you should be using if your intent is to stack the images.

In the second case, try doing

cl\$this->_split2($m[0]) reset use_new_imt = no

to bypass the new image template code which I think is getting confused by the extension syntax.