[LA-SiGMA] HPC Training: Shell Scripting 1

[Feng Chen]

Dear All,

The Schedule for the Spring 2015 HPC Training is available at http://www.hpc.lsu.edu/training/tutorials.php.

Our next HPC training will be held on Wednesday, Feb. 11 at 9:30 AM in 307 Frey and broadcast through Adobe Connect for remote users. Note that all HPC trainings will start at 9:30AM.

Wednesday, Feb. 11, 2015: Shell Scripting 1
For anyone who works in a Linux/Unix environment, a working knowledge of shell scripting is essential and will boost their efficiency and productivity tremendously. For this tutorial, we will focus on bash as it is one of the most popular shells. This two part tutorial will include topics such as creating simple bash scripts, flow control, command line arguments, regex, grep, awk and sed. This is a practical tutorial, so we will provide examples and/or hands-on exercises for most of the covered materials.
Prerequisites: Basic Knowledge of Linux/UNIX environment including basic shell scripting (creating and editing files, changing file permissions and executing scripts from command line). You are expected to be familiar with emacs or vi editor. No help will be provided in this class with using these or any other editors. Please complete the vim tutorial exercise in Introduction To Linux.

Next HPC Training:

Wednesday, Feb. 25, 2015: Distributed Job Execution
While the steadily increasing core counts of modern day processors continue to favor large-scale distributed and multi-threaded applications, the demand for serial processing has surged as non-traditional fields, such as computational biology, increasingly adapt computational methods. This presents a problem on clusters tuned for massively parallel processing. One solution is to tune the job scheduler to carve out resources primarily for serial jobs which complicates system management. The other, taken here, is to adapt existing shell features to facilitate running many essentially embarrassingly parallel tasks under one job script. Running tasks in the background works well for small numbers of tasks, but recent requirements for managing 10's of thousands of such tasks required a better approach - motivating the creation of WQ. It consists of a Python script that implements a run-time aware distribution-worker model, a PBS script with an absolute minimum number of moving parts, and a script or command to execute a single task. This presentation reviews shell job control features, the discusses the implementation of WQ. Examples will include purely serial, multi-threaded, and small MPI tasks.
Prerequisites: Beginner to intermediate level knowledge of shell scripting and PBS job submission is assumed, but not required.

Please visit http://www.hpc.lsu.edu/training/tutorials.php for more details and register using the link provided.
Users who plan on joining remotely will be provided with an Adobe Connect Link in their registration confirmation email. Please see the system requirements at http://connect.grok.lsu.edu/Categories.aspx?parentCategoryId=1519.

Please distribute to faculty, staff and students that might be interested.

Thanks,

Feng Chen, Ph.D.
IT Consultant
329, Frey Computing Services Center,
Louisiana State University,
Baton Rouge, LA 70803
Voice: (225) 578-2924
eMail: fchen14 at lsu.edu<mailto:fchen14 at lsu.edu>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: https://mail.loni.org/mailman/private/lasigma/attachments/20150209/a71ccdbc/attachment.html