ALMA Data Handling Workshop - Revision history

Massardi: Undo revision 2859 by Massardi (talk)

2016-12-07T13:16:09Z

Undo revision 2859 by Massardi (talk)

← Older revision		Revision as of 15:16, 7 December 2016
Line 1:		Line 1:
	'''9-12 February 2016 - Area della Ricerca Bologna, Italy'''		'''9-12 February 2016 - Area della Ricerca Bologna, Italy'''

	The Italian node of the European ALMA Regional Center is pleased to announce a ~~1.5~~-day workshop on to the ~~archive activity~~ and the imaging ~~pipeline~~ in ~~Bologna~~ on ~~the 24th-25th of January dedicated~~ to ~~members of~~ the ~~ARC network~~.		The Italian node of the European ALMA Regional Center is pleased to announce a 4-day ALMA data analysis workshop, with the aim to assist users in learning how to (re)process ALMA data, from raw data to the production of calibrated images and data analysis.
	~~We would like~~ to ~~discuss~~ with ~~all~~ the ~~people in~~ the ~~European~~ ARC ~~network about~~ the ~~archive~~-~~related~~ on~~-going activities~~ and the ~~tools~~ and ~~programs that are being developed in its framework~~. To ~~achieve most of these purposes~~ the ~~imaging pipeline plays a crucial role~~. ~~A few contributed talks on related topics or archive mining science programs could be allocated~~.
			The program will include lectures to introduce the key concepts in the calibration and imaging of interferometric data, and hands-on sessions which will demonstrate their application in the Common Astronomy Software Applications (CASA) package.

			Participants will be requested to work on their own laptops. Details on CASA versions and data downloads will be communicated later to the registered participants.


			The workshop is open to researchers, post-docs and students interested in working with ALMA data, either their own or taken from the archive. Novice users are welcome!

			== Accessing the ARC cluster ==

			* The folders used for the school will be available up to Feb 29th. To access the ARC cluster do '''ssh -X almauserN@scheduler.ira.inaf.it '''. To work remotely on the school datasets (in scuola/) we suggest to create two individual folders and copy all the files you need into them.

			* If you want to copy files from the cluster to your own machine, you need to type: '''scp almauserN@storage.alma.inaf.it:scuola/nomefile .'''

			* If you want to use the ARC cluster to work on your ALMA data please contact help-desk@alma.inaf.it and visit: http://www.alma.inaf.it/index.php/The_ARC_cluster for instructions.

			* To fix the CASA viewer problem in the spectral line panel, Linux users can copy [[Media: Profiler.conf.txt\|this file]] into their .config/NRAO/CASA/Spectral Profiler.conf file.

	== Program ==		== Program ==

	~~The preliminary agenda is~~ the ~~following~~		* February 9th
			14:00 14:15 Welcome
			14:15 15:30 [[Media:interf-intro.pdf\| Introduction to Interferometry]]
			15:30 16:45 [[Media:ALMA_dataschool.pdf\| ALMA]]
			16:45 17:00 coffee break
			17:00 17:15 Hands-on: Sensitivity Calculator
			17:15 18:00 Hands-on: UV plane visualization [[Media:Additional models.zip \| additional models]]

			* February 10th
			9:30 10:00 [[Media:introcasa.pdf \| CASA introduction]]
			10:00 10:45 [[Media:ALMA_archive_dataschool.pdf \| Alma archive and data tree]]
			10:45 11:15 coffee break
			11:15 12:00 Hands on exploring the archive [[Media:ArchiveHandsOn.txt \| Hands on instructions]]
			12:00 13:00 [[Media:calib.pdf \|Calibration- Introduction ]]

			13:00 Lunch break

	-~~⁠Morning Jan 24th~~		14:00 15:30 Hands-on: Checking the calibration results with plotms [[Media:plotms.pdf \| plotms instructions]]
	~~session 1~~: ~~archive statistics, on-going activities and development plan~~		15:30 16:00 coffee break
	* Status of the ~~archive, development plan and open issues (what is needed to set the stage)~~		16:00 18:00 Hands-on: QA2 report/weblog [[Media: tiny_data.zip \| tiny dataset]] [[Media: qa_manual.zip \| qa manual]] [[Media:weblog.pdf \| weblog]]
	* The ALMA Re-Imaging development study: ~~overview of its needs and purpose (Marcella)~~
	* Contributed talks
	* Short discussion session: ~~initial collection of participation to archive~~-~~related activities~~

	-~~⁠Afternoon Jan 24th~~		* February 11th
	~~session 2~~: ~~tools for the archive~~: ~~pipeline et al~~.		9:30 10:30 [[Media:Imaging_feb16.pdf \|Imaging - Introduction]]
	* Description of the imaging pipeline (John Hibbard)		10:30 11:30 Hands-on: Imaging [[Media:ImagingScript4school.py \|script_NGC1614]]
	* Demonstration of PL features and products		11:30 12:00 coffee break
	* Tests of pipeline applicability to the archive data (Felix)		12:00 13:00 Hands-on: Imaging
	* The keyword filler program (Elisabetta)
	* Discussion session (wish list of keywords, interaction pipeline-~~archive-filler-AQUA, definition of quality=science-readiness of PL products)~~

	-~~⁠Morning Jan 25th~~		13:00 Lunch break
	~~session 3⁠ (guided discussion, chair~~: ~~Marcella, Felix)~~
	* ~~contributed talks~~		14:00 15:30 Hands-on: [[Media:image_analysis2.pdf \|Data products analysis]] [[Media:analysis_script2.py \| Analysis script]]
	* To do list for the archive (re-~~⁠imaging et al~~.~~..)~~		15:30 16:00 coffee break
	* Management issues for re-imaging activities (actions, ~~quality control~~, ~~communications~~, ~~products~~, ~~future meetings)~~		16:00 18:00 Hands-on: Data products analysis

			* February 12th
			9:30 10:00 [[Media:Selfcalibration.pdf \|Self calibration]]
			10:00 11:00 Hands-on: self calibration
			11:00 11:30 coffee break
			11:30 12:30 Hands-on: self calibration [[File:selfcal_script4school.py]]




			The trainers will be Nuria Marcelino, Marcella Massardi, Arturo Mignano, Rosita Paladino, and Kazi Rygl, members of the Italian Node of the ALMA Regional Centre.

	== Participants ==		== Participants ==
			View the list of registered participants
			[[Media:Participants-050216.txt\| here ]]
			(updated to February 5, 2016)

	== Registration ==		== Registration ==
	~~Please fill the form on the webpage by the 10th of January~~

			Registration has closed on December 15th, 2015.

			No fee is required. For logistical reasons, a maximum of 40 participants can be accepted, on a "first come first serve” basis.

			'''We have reached the maximum number of participants, and have a short waiting list. If any of the registered participants cannot be present, they are kindly requested to inform the organizers as soon as possible, so that their place can be taken by someone else.'''

	== Venue, Logistics & contacts ==		== Venue, Logistics & contacts ==

	The workshop will take place in the ~~IRA Seminar Room at the 4th~~ floor ~~of the IRA institute~~.		The workshop will take place in the [http://www.bo.cnr.it/index-eng.html CNR Research Area] in Bologna, room 216 (main hall, first floor).


	The [http://www.ira.inaf.it/Home.html Institute of Radioastronomy] is located in the ~~[http://www.bo.cnr.it/index-eng.html~~ CNR Research Area] in Bologna. It can be reached by following the directions given [http://www.bo.cnr.it/comearrivare-eng.html here].<br>		The [http://www.ira.inaf.it/Home.html Institute of Radioastronomy] is located in the CNR Research Area in Bologna. It can be reached by following the directions given [http://www.bo.cnr.it/comearrivare-eng.html here].<br>
	A selection of hotels in Bologna can be found in this [http://www.bo.cnr.it/congressi/alberghi.html list].		A selection of hotels in Bologna can be found in this [http://www.bo.cnr.it/congressi/alberghi.html list].

Massardi: Undo revision 2860 by Massardi (talk)

2016-12-07T13:15:11Z

Undo revision 2860 by Massardi (talk)

← Older revision		Revision as of 15:15, 7 December 2016
Line 1:		Line 1:
	'''24-~~25 January 2017~~ - ~~IRA Istituto di Radioastronomia,~~ Bologna, Italy'''		'''9-12 February 2016 - Area della Ricerca Bologna, Italy'''

	The Italian node of the European ALMA Regional Center is pleased to announce a 1.5-day workshop on to the archive activity and the imaging pipeline in Bologna on the 24th-25th of January dedicated to members of the ARC network.		The Italian node of the European ALMA Regional Center is pleased to announce a 1.5-day workshop on to the archive activity and the imaging pipeline in Bologna on the 24th-25th of January dedicated to members of the ARC network.

Massardi at 13:11, 7 December 2016

2016-12-07T13:11:39Z

← Older revision		Revision as of 15:11, 7 December 2016
Line 1:		Line 1:
	'''9-~~12 February 2016~~ - ~~Area della Ricerca~~ Bologna, Italy'''		'''24-25 January 2017 - IRA Istituto di Radioastronomia, Bologna, Italy'''

	The Italian node of the European ALMA Regional Center is pleased to announce a 1.5-day workshop on to the archive activity and the imaging pipeline in Bologna on the 24th-25th of January dedicated to members of the ARC network.		The Italian node of the European ALMA Regional Center is pleased to announce a 1.5-day workshop on to the archive activity and the imaging pipeline in Bologna on the 24th-25th of January dedicated to members of the ARC network.

Massardi at 13:10, 7 December 2016

2016-12-07T13:10:56Z

← Older revision		Revision as of 15:10, 7 December 2016
Line 1:		Line 1:
	'''9-12 February 2016 - Area della Ricerca Bologna, Italy'''		'''9-12 February 2016 - Area della Ricerca Bologna, Italy'''

	The Italian node of the European ALMA Regional Center is pleased to announce a 4-day ~~ALMA data analysis~~ workshop~~, with the aim to assist users in learning how to (re)process ALMA data, from raw data~~ to the ~~production of calibrated images~~ and ~~data analysis.~~		The Italian node of the European ALMA Regional Center is pleased to announce a 1.5-day workshop on to the archive activity and the imaging pipeline in Bologna on the 24th-25th of January dedicated to members of the ARC network.
			We would like to discuss with all the people in the European ARC network about the archive-related on-going activities and the tools and programs that are being developed in its framework. To achieve most of these purposes the imaging pipeline plays a crucial role. A few contributed talks on related topics or archive mining science programs could be allocated.
	~~The program will include lectures to introduce~~ the ~~key concepts~~ in the ~~calibration and imaging~~ of ~~interferometric data, and hands-on sessions which will demonstrate their application in the Common Astronomy Software Applications (CASA) package.~~

	~~Participants will be requested to work on their own laptops. Details on CASA versions and data downloads will be communicated later~~ to the ~~registered participants~~.


	~~The workshop is open~~ to ~~researchers, post-docs and students interested in working~~ with ~~ALMA data, either their own or taken from~~ the ~~archive. Novice users are welcome!~~

	~~== Accessing~~ the ARC ~~cluster ==~~

	* The folders used for the ~~school will be available up to Feb 29th. To access the ARC cluster do '''ssh~~ -~~X almauserN@scheduler.ira.inaf.it '''. To work remotely~~ on ~~the school datasets (in scuola/) we suggest to create two individual folders~~ and ~~copy all the files you need into them.~~

	* If you want to copy files from the cluster to your own machine, you need to type: '''scp almauserN@storage.alma.inaf.it:scuola/nomefile .'''

	* If you want to use the ~~ARC cluster to work on your ALMA data please contact help-desk@alma.inaf.it~~ and ~~visit: http://www~~.~~alma.inaf.it/index.php/The_ARC_cluster for instructions.~~

	* To ~~fix~~ the ~~CASA viewer problem in the spectral line panel, Linux users can copy [[Media: Profiler~~.~~conf.txt\|this file]] into their .config/NRAO/CASA/Spectral Profiler.conf file~~.

	== Program ==		== Program ==

	* February 9th		The preliminary agenda is the following
	~~14:00 14:15 Welcome~~
	~~14:15 15:30 [[Media:interf-intro.pdf\| Introduction to Interferometry]]~~
	~~15:30 16:45 [[Media:ALMA_dataschool.pdf\| ALMA]]~~
	~~16:45 17:00 coffee break~~
	~~17:00 17:15 Hands-on: Sensitivity Calculator~~
	~~17:15 18:00 Hands-on: UV plane visualization [[Media:Additional models.zip \| additional models]]~~

	* February 10th
	~~9:30 10:00 [[Media:introcasa.pdf \| CASA introduction]]~~
	~~10:00 10:45 [[Media:ALMA_archive_dataschool.pdf \| Alma archive and data tree]]~~
	~~10:45 11:15 coffee break~~
	~~11:15 12:00 Hands on exploring~~ the ~~archive [[Media:ArchiveHandsOn.txt \| Hands on instructions]]~~
	~~12:00 13:00 [[Media:calib.pdf \|Calibration- Introduction ]]~~

	~~13:00 Lunch break~~

	~~14:00 15:30 Hands~~-~~on: Checking~~ the ~~calibration results with plotms [[Media~~:~~plotms.pdf \| plotms instructions]]~~		-⁠Morning Jan 24th
	~~15:30 16:00 coffee break~~		session 1: archive statistics, on-going activities and development plan
	16:~~00 18:00 Hands~~-~~on: QA2 report/weblog [[Media: tiny_data.zip \| tiny dataset]] [[Media: qa_manual.zip \| qa manual]] [[Media:weblog.pdf \| weblog]]~~		* Status of the archive, development plan and open issues (what is needed to set the stage)
			* The ALMA Re-Imaging development study: overview of its needs and purpose (Marcella)
			* Contributed talks
			* Short discussion session: initial collection of participation to archive-related activities

	* February 11th		-⁠Afternoon Jan 24th
	~~9:30 10~~:~~30 [[Media~~:~~Imaging_feb16~~.~~pdf \|Imaging - Introduction]]~~		session 2: tools for the archive: pipeline et al.
	~~10:30 11:30 Hands-on: Imaging [[Media:ImagingScript4school.py \|script_NGC1614]]~~		* Description of the imaging pipeline (John Hibbard)
	~~11:30 12:00 coffee break~~		* Demonstration of PL features and products
	~~12:00 13:00 Hands~~-~~on: Imaging~~		* Tests of pipeline applicability to the archive data (Felix)
			* The keyword filler program (Elisabetta)
			* Discussion session (wish list of keywords, interaction pipeline-archive-filler-AQUA, definition of quality=science-readiness of PL products)

	13:~~00 Lunch break~~		-⁠Morning Jan 25th
			session 3⁠ (guided discussion, chair: Marcella, Felix)
	~~14:00 15:30 Hands~~-~~on: [[Media:image_analysis2~~.~~pdf \|Data products analysis]] [[Media:analysis_script2~~.~~py \| Analysis script]]~~		* contributed talks
	~~15:30 16:00 coffee break~~		* To do list for the archive (re-⁠imaging et al...)
	~~16:00 18:00 Hands-on: Data products analysis~~		* Management issues for re-imaging activities (actions, quality control, communications, products, future meetings)

	* ~~February 12th~~
	~~9:30 10:00 [[Media:Selfcalibration.pdf \|Self calibration]]~~
	~~10:00 11:00 Hands-on: self calibration~~
	~~11:00 11:30 coffee break~~
	~~11:30 12:30 Hands~~-~~on: self calibration [[File:selfcal_script4school.py]]~~




	~~The trainers will be Nuria Marcelino~~, ~~Marcella Massardi~~, ~~Arturo Mignano~~, ~~Rosita Paladino, and Kazi Rygl~~, ~~members of the Italian Node of the ALMA Regional Centre.~~

	== Participants ==		== Participants ==
	~~View the list of registered participants~~
	~~[[Media:Participants-050216.txt\| here ]]~~
	~~(updated to February 5, 2016)~~

	== Registration ==		== Registration ==
			Please fill the form on the webpage by the 10th of January

	~~Registration has closed on December 15th, 2015.~~

	~~No fee is required. For logistical reasons, a maximum of 40 participants can be accepted, on a "first come first serve” basis.~~

	'''We have reached the maximum number of participants, and have a short waiting list. If any of the registered participants cannot be present, they are kindly requested to inform the organizers as soon as possible, so that their place can be taken by someone else.'''

	== Venue, Logistics & contacts ==		== Venue, Logistics & contacts ==

	The workshop will take place in the ~~[http://www.bo.cnr.it/index-eng.html CNR Research Area] in Bologna, room 216 (main hall, first~~ floor).		The workshop will take place in the IRA Seminar Room at the 4th floor of the IRA institute.


	The [http://www.ira.inaf.it/Home.html Institute of Radioastronomy] is located in the CNR Research Area in Bologna. It can be reached by following the directions given [http://www.bo.cnr.it/comearrivare-eng.html here].<br>		The [http://www.ira.inaf.it/Home.html Institute of Radioastronomy] is located in the [http://www.bo.cnr.it/index-eng.html CNR Research Area] in Bologna. It can be reached by following the directions given [http://www.bo.cnr.it/comearrivare-eng.html here].<br>
	A selection of hotels in Bologna can be found in this [http://www.bo.cnr.it/congressi/alberghi.html list].		A selection of hotels in Bologna can be found in this [http://www.bo.cnr.it/congressi/alberghi.html list].

Marcelino: /* Program */

2016-03-07T10:07:21Z

Program

← Older revision		Revision as of 12:07, 7 March 2016
Line 51:		Line 51:
	13:00 Lunch break		13:00 Lunch break

	14:00 15:30 Hands-on: [[Media:~~image_analysis~~.pdf \|Data products analysis]] [[Media:~~analysis_script~~.py \| Analysis script]]		14:00 15:30 Hands-on: [[Media:image_analysis2.pdf \|Data products analysis]] [[Media:analysis_script2.py \| Analysis script]]
	15:30 16:00 coffee break		15:30 16:00 coffee break
	16:00 18:00 Hands-on: Data products analysis		16:00 18:00 Hands-on: Data products analysis

Paladino: /* Program */

2016-03-02T12:12:04Z

Program

← Older revision		Revision as of 14:12, 2 March 2016
Line 45:		Line 45:
	* February 11th		* February 11th
	9:30 10:30 [[Media:Imaging_feb16.pdf \|Imaging - Introduction]]		9:30 10:30 [[Media:Imaging_feb16.pdf \|Imaging - Introduction]]
	10:30 11:30 Hands-on: Imaging [[Media:ImagingScript4school.py \|script_NGC1614~~]] [[Media:script4school_galactic.py \|script_IRAS16~~]]		10:30 11:30 Hands-on: Imaging [[Media:ImagingScript4school.py \|script_NGC1614]]
	11:30 12:00 coffee break		11:30 12:00 coffee break
	12:00 13:00 Hands-on: Imaging		12:00 13:00 Hands-on: Imaging

Paladino: /* Accessing the ARC cluster */

2016-02-16T14:28:52Z

Accessing the ARC cluster

← Older revision		Revision as of 16:28, 16 February 2016
Line 14:		Line 14:
	* The folders used for the school will be available up to Feb 29th. To access the ARC cluster do '''ssh -X almauserN@scheduler.ira.inaf.it '''. To work remotely on the school datasets (in scuola/) we suggest to create two individual folders and copy all the files you need into them.		* The folders used for the school will be available up to Feb 29th. To access the ARC cluster do '''ssh -X almauserN@scheduler.ira.inaf.it '''. To work remotely on the school datasets (in scuola/) we suggest to create two individual folders and copy all the files you need into them.

	* If you want to copy files from the cluster to your own machine, you need to type: '''scp almauserN@storage.alma.inaf.it:scuola/nomefile'''		* If you want to copy files from the cluster to your own machine, you need to type: '''scp almauserN@storage.alma.inaf.it:scuola/nomefile .'''

	* If you want to use the ARC cluster to work on your ALMA data please contact help-desk@alma.inaf.it and visit: http://www.alma.inaf.it/index.php/The_ARC_cluster for instructions.		* If you want to use the ARC cluster to work on your ALMA data please contact help-desk@alma.inaf.it and visit: http://www.alma.inaf.it/index.php/The_ARC_cluster for instructions.

Paladino: /* Accessing the ARC cluster */

2016-02-16T14:21:09Z

Accessing the ARC cluster

← Older revision		Revision as of 16:21, 16 February 2016
Line 12:		Line 12:
	== Accessing the ARC cluster ==		== Accessing the ARC cluster ==

	* The folders used for the school will be available up to Feb 29th.		* The folders used for the school will be available up to Feb 29th. To access the ARC cluster do '''ssh -X almauserN@scheduler.ira.inaf.it '''. To work remotely on the school datasets (in scuola/) we suggest to create two individual folders and copy all the files you need into them.
	To access the ARC cluster do '''ssh -X almauserN@scheduler.ira.inaf.it '''.
	To work remotely on the school datasets (in scuola/) we suggest to create two individual folders and copy all the files you need into them.

	* If you want to copy files from the cluster to your own machine, you need to type: '''scp almauserN@storage.alma.inaf.it:scuola/nomefile'''		* If you want to copy files from the cluster to your own machine, you need to type: '''scp almauserN@storage.alma.inaf.it:scuola/nomefile'''

Paladino: /* Accessing the ARC cluster */

2016-02-16T14:20:03Z

Accessing the ARC cluster

← Older revision		Revision as of 16:20, 16 February 2016
Line 12:		Line 12:
	== Accessing the ARC cluster ==		== Accessing the ARC cluster ==

	* The folders used for the school will be available up to Feb 29th. To access the ARC cluster do '''ssh -X almauserN@scheduler.ira.inaf.it '''. To work remotely on the school datasets (in scuola/) we suggest to create two individual folders and copy all the files you need into them.		* The folders used for the school will be available up to Feb 29th.
			To access the ARC cluster do '''ssh -X almauserN@scheduler.ira.inaf.it '''.
			To work remotely on the school datasets (in scuola/) we suggest to create two individual folders and copy all the files you need into them.

	* If you want to copy files from the cluster to your own machine, you need to type: '''scp almauserN@storage.alma.inaf.it:scuola/nomefile'''		* If you want to copy files from the cluster to your own machine, you need to type: '''scp almauserN@storage.alma.inaf.it:scuola/nomefile'''

Paladino: /* Accessing the ARC cluster */

2016-02-16T14:19:26Z

Accessing the ARC cluster

← Older revision		Revision as of 16:19, 16 February 2016
Line 12:		Line 12:
	== Accessing the ARC cluster ==		== Accessing the ARC cluster ==

	* ~~If you need~~ to access the ARC cluster ~~up to Feb 29th,~~ do '''ssh -X almauserN@scheduler.ira.inaf.it '''. To work on the school datasets (in scuola/) we suggest to create two individual folders and copy all the files you need into them.		* The folders used for the school will be available up to Feb 29th. To access the ARC cluster do '''ssh -X almauserN@scheduler.ira.inaf.it '''. To work remotely on the school datasets (in scuola/) we suggest to create two individual folders and copy all the files you need into them.

	* If you want to copy files from the cluster to your own machine, you need to type: '''scp almauserN@storage.alma.inaf.it:scuola/nomefile'''		* If you want to copy files from the cluster to your own machine, you need to type: '''scp almauserN@storage.alma.inaf.it:scuola/nomefile'''