Wrangler User News

October 2017 TACC Training Events

Posted by Jason Allison on Sep 15, 2017 4:14:45 PM

I am pleased to announce the following training events are being offered to both in-person and webcast participants for October 2017. Local participants are strongly encouraged to attend in person. 10/4/17 - Introduction To Hadoop And Spark On Wrangler 10/6/17 - MPI Foundations I and MPI...

I am pleased to announce the following training events are being offered to both in-person and webcast participants for October 2017. Local participants are strongly encouraged to attend in person.

10/4/17 - Introduction To Hadoop And Spark On Wrangler
10/6/17 - MPI Foundations I and MPI Foundations II
10/11/17 - Introduction to Scala/Spark
10/18/17 - Data Analysis Using Hadoop/Spark

To register and for more information please visit: https://portal.tacc.utexas.edu/training

Wrangler status August 29 2017

Posted by David Littrell on Aug 23, 2017 11:59:50 AM

Wrangler will be unavailable from 8:00am to 5:00pm CST on Tuesday 29 August 2017 for system maintenance.

Updated on Aug 29, 2017 6:03:06 PM

Wrangler is back up in production as of 6:00pm CST, Tuesday 29, August 2017

Updated on Aug 29, 2017 4:31:08 PM

Maintenance on Wrangler has been extended. Currently, there is no ETA for when it will be back up in production. 

Original Posting

Wrangler will be unavailable from 8:00am to 5:00pm CST on Tuesday 29 August 2017 for system maintenance.

Wrangler Maintenance 22 August 2017

Posted by Jacob Getz on Aug 22, 2017 8:25:28 AM

Wrangler will be unavailable from 8:00am to 5:00pm CST on Tuesday 22 August 2017 for system maintenance.

Updated on Aug 22, 2017 6:39:46 PM

Wrangler has been returned to production as of 6:30pm CST. 

Updated on Aug 22, 2017 4:56:06 PM

Maintenance on Wrangler has taken longer than expected and we hope to have it available by 8:00pm CST on Tuesday 22 August 2017. 

Original Posting

Wrangler will be unavailable from 8:00am to 5:00pm CST on Tuesday 22 August 2017 for system maintenance.

Wrangler Status August 15, 2017

Posted by David Littrell on Aug 9, 2017 11:34:54 AM

We will be having a Wrangler maintenance 8/15 @ 8am-5pm to complete some work on fixing a degraded OSS on the /data Lustre filesystem with Dell On-Site support.

Updated on Aug 15, 2017 3:35:45 PM

Today's Wrangler maintenance has concluded.


-TACC Team

Original Posting

We will be having a Wrangler maintenance 8/15 @ 8am-5pm to complete some work on fixing a degraded OSS on the /data Lustre filesystem with Dell On-Site support.

TACC Maintenance 18 July, 2017

Posted by Jacob Getz on Jul 11, 2017 9:47:53 AM

Access to all TACC systems will be unavailable from 7:00 AM CDT on July 18 until 8:00 AM CDT on July 19 to allow for upgrades to the core network switch hardware and to perform system maintenance on the Stockyard global filesystem.   Users will have intermittent access to all TACC services and...

Updated on Jul 19, 2017 6:25:46 PM

The /work filesystem has been restored on all TACC production systems.   All held user jobs have been released from the hold and should be running or queued to run now.
 
Thank you, 

-TACC

Updated on Jul 19, 2017 9:55:21 AM

Maintenance has been extended for the Stockyard global filesystem.  An update will be posted to User News when resources are back in full production.

Original Posting

Access to all TACC systems will be unavailable from 7:00 AM CDT on July 18 until 8:00 AM CDT on July 19 to allow for upgrades to the core network switch hardware and to perform system maintenance on the Stockyard global filesystem.   Users will have intermittent access to all TACC services and systems until the core network switch upgrade is complete.  

During this maintenance window, the production systems Stampede2, Stampede, Lonestar5, Maverick, Wrangler, Ranch, and Hikari will also be down for system maintenance and unavailable to users until after the Stockyard global filesystem maintenance has been completed.   Updates to user news will be sent once network services have been restored and when the production systems are restored to normal operations.

-TACC Team

Stampede 2 status, July 19, 2017

Posted by David Littrell on Jul 19, 2017 10:37:17 AM

The Stampede2 system is back available to users, however, the /work filesystem remains offline for system maintenance.  To prevent queued jobs from failing, all current pending user jobs were held.  If your jobs do not require the /work filesystem, use the command "scontrol release " with...

Updated on Jul 19, 2017 6:23:35 PM

The /work filesystem has been restored on all TACC production systems.   All held user jobs have been released from the hold and should be running or queued to run now.
 
Thank you, 
 
-TACC

Original Posting

The Stampede2 system is back available to users, however, the /work filesystem remains offline for system maintenance.  To prevent queued jobs from failing, all current pending user jobs were held.  If your jobs do not require the /work filesystem, use the command "scontrol release <jobid>" with your specific job numbers in place of <jobid>

TACC Sitewide Power Event 6-23-17

Posted by Jacob Getz on Jun 23, 2017 9:30:03 AM

At 1:15 AM Central Time, TACC and our facilities experienced a power outage. Every TACC system was affected. Power has since been restored. An update will be posted to User News when resources are back in full production.


-TACC Team

Updated on Jun 23, 2017 10:37:04 PM

All TACC systems and services have been restored to normal operation after the power loss this morning.  Please submit a ticket if you encounter any problems with access to TACC systems or services.

Original Posting

At 1:15 AM Central Time, TACC and our facilities experienced a power outage. Every TACC system was affected. Power has since been restored. An update will be posted to User News when resources are back in full production.


-TACC Team

TACC status 19 July, 2017

Posted by David Littrell on Jun 21, 2017 11:02:50 AM

Access to all TACC systems will be unavailable from 7:00 AM CDT on July 18 until 8:00 AM CDT on July 19 to allow for upgrades to the core network switch hardware and to perform system maintenance on the Stockyard global filesystem.   Users will have intermittent access to all TACC services and...

Updated on Jun 21, 2017 11:22:47 AM

Jetstream will also be affected. 

Original Posting

Access to all TACC systems will be unavailable from 7:00 AM CDT on July 18 until 8:00 AM CDT on July 19 to allow for upgrades to the core network switch hardware and to perform system maintenance on the Stockyard global filesystem.   Users will have intermittent access to all TACC services and systems until the core network switch upgrade is complete.  During this maintenance window, the production systems Stampede2, Stampede, Lonestar5, Maverick, Wrangler and Hikari will also be down for system maintenance and unavailable to users until after the Stockyard global filesystem maintenance has been completed.   Updates to user news will be sent once network services have been restored and when the production systems are restored to normal operations.

Computational Science in the Cloud Institute at TACC – 7/24-28/2017

Posted by Jason Allison on May 25, 2017 2:56:56 PM

This 5-day workshop will provide participants with an end-to-end introduction to performing scientific simulations and analyses in a cloud-based environment. Participants will build their own virtual machines, setup Jupyter notebooks, learn to use APIs for provisioning and bootstrapping VMs, attach...

Updated on Jun 13, 2017 11:14:57 AM

We still have spaces available for the Computational Science in the Cloud Institute - July 24th through July 28th, 2017.  Please register ASAP to avoid missing out on this opportunity.

Original Posting

This 5-day workshop will provide participants with an end-to-end introduction to performing scientific simulations and analyses in a cloud-based environment. Participants will build their own virtual machines, setup Jupyter notebooks, learn to use APIs for provisioning and bootstrapping VMs, attach VMs to cloud and object storage, use containers for simplifying and standardizing VM deployment, and automate deployment of VMs with different tools. Participants will also learn how to use the Agave API for managing and collaborating in cloud environments.

Price for students, faculty, and academic researchers is $400.

Registration details and full agenda can be found at:
https://www.tacc.utexas.edu/education/institutes/computational-science-in-the-cloud.

Parallel Programming Foundations Institute at TACC – July 31-August 4, 2017

Posted by Jason Allison on Jun 2, 2017 3:23:57 PM

This 5-day workshop will provide participants with an introduction to developing parallel applications for modern HPC systems. Participants will learn about profiling and optimizing applications, concepts for domain and data decomposition, developing shared-memory parallel applications using OpenMP...

Updated on Jun 13, 2017 11:08:33 AM

We still have spaces available for Parallel Programming Foundations Institute - July 31st through August 4th, 2017.  Please register ASAP to avoid missing out on this opportunity.

Updated on Jun 2, 2017 3:37:23 PM

The original dates that were posted for this event were incorrect. The correct dates for the Parallel Programming Foundations Institute at TACC Institute are July 31st through August 4th, 2017.

Original Posting

This 5-day workshop will provide participants with an introduction to developing parallel applications for modern HPC systems. Participants will learn about profiling and optimizing applications, concepts for domain and data decomposition, developing shared-memory parallel applications using OpenMP and distributed-memory parallel applications using MPI, creating hybrid OpenMP/MPI applications for modern manycore architectures, and debugging parallel applications. Hands-on exercises done on the new Stampede2 supercomputer at TACC will help participants to better understand lecture concepts using concrete examples on modern hardware.

Price for students, faculty, and academic researchers is $400.

Registration details and full agenda can be found at:
https://www.tacc.utexas.edu/education/institutes/parallel-programming-foundations

Wrangler Maintenance 6 June 2017

Posted by Sergio Leal on May 23, 2017 4:09:15 PM

Wrangler will not be available from 8 a.m. to 5:00 p.m on Tuesday, June 6, 2017. System maintenance and general updates  will be performed during this time.

Thank you.

- TACC Team

Updated on Jun 6, 2017 3:56:08 PM

The Wrangler maintenance for 6/6 has completed ahead of the 1700 end time and all systems are good to go/available.


-TACC Team

Original Posting

Wrangler will not be available from 8 a.m. to 5:00 p.m on Tuesday, June 6, 2017. System maintenance and general updates  will be performed during this time.

Thank you.

- TACC Team

Webinar: Introduction to TACC Resources for UT System Institutions

Posted by Jason Allison on Jun 6, 2017 1:51:32 PM

Wednesday, June 14, 2017 Time: 11:30am-12:15pm CT The Texas Advanced Computing Center (TACC) at The University of Texas at Austin is expanding to deliver even more computing resources to all 14 UT System Academic and Health Institutions. This initiative, funded by UT System, aims to increase...

Wednesday, June 14, 2017
Time: 11:30am-12:15pm CT

The Texas Advanced Computing Center (TACC) at The University of Texas at Austin is expanding to deliver even more computing resources to all 14 UT System Academic and Health Institutions. This initiative, funded by UT System, aims to increase research support across all UT campuses. This webinar will give a brief presentation on how UT System investigators can leverage TACC resources to advance their research. We will be answering questions after the webinar.

Questions?: Email lifesci@consult.tacc.utexas.edu

Registration:https://portal.tacc.utexas.edu/training#/session/68

Wrangler Maintenance 31 May 2017

Posted by Jacob Getz on May 30, 2017 3:07:06 PM

Emergency maintenance to Wrangler will begin at 9 AM local time on 5/31. There should be no hard down time to Wrangler, however, performance may be slightly degraded. We currently estimate the maintenance window to extend into the afternoon.

-TACC Team

Updated on May 31, 2017 12:07:41 PM

After doing some emergency surgery on dssd08 in Wrangler we are now back to optimal/normal standards and running fine. Please let me/us know if you need anything else or have any questions.


-TACC Team

Original Posting

Emergency maintenance to Wrangler will begin at 9 AM local time on 5/31. There should be no hard down time to Wrangler, however, performance may be slightly degraded. We currently estimate the maintenance window to extend into the afternoon.

-TACC Team

Data and Information Analytics Institute at TACC – 6/19-23/2017

Posted by Jason Allison on May 25, 2017 2:48:53 PM

This 5-day workshop will introduce participants to best practices for large-scale data analysis using Python, R, and Hadoop/Spark, as well as an introduction to data management, working with databases, and machine learning. Participants will also receive introductions to current state of the...

This 5-day workshop will introduce participants to best practices for large-scale data analysis using Python, R, and Hadoop/Spark, as well as an introduction to data management, working with databases, and machine learning. Participants will also receive introductions to current state of the practice in geospatial, biomedical, and information visualization. Price for students, faculty, and academic researchers is $400.

Registration details and full agenda can be found at:
https://www.tacc.utexas.edu/education/institutes/data-and-information-analytics.

Visualizing and Interacting with Data Institute at TACC – 6/19-23/2017

Posted by Jason Allison on May 25, 2017 2:42:13 PM

This 5-day workshop will introduce participants to tools and best practices for remote and collaborative visualization of scientific data, developing visualizations using virtual reality and augmented reality interfaces, and building visualization systems like large tiled-displays. Participants...

This 5-day workshop will introduce participants to tools and best practices for remote and collaborative visualization of scientific data, developing visualizations using virtual reality and augmented reality interfaces, and building visualization systems like large tiled-displays. Participants will also receive introductions to current state of the practice in geospatial, biomedical, and information visualization.

Price for students, faculty, and academic researchers is $400.

Registration details and full agenda can be found at:
https://www.tacc.utexas.edu/education/institutes/visualizing-and-interacting-with-data.

Visualizing and Interacting with Data

Posted by Jason Allison on May 5, 2017 4:28:36 PM

June 19-23, 2017 Ready to get more from your data than simple charts? Spend a week with TACC's visualization experts learning how to generate rich, informative visualizations for your simulation results and data analyses. Get starting with VisIt and Paraview, learn the basics of developing...

June 19-23, 2017

Ready to get more from your data than simple charts? Spend a week with TACC's visualization experts learning how to generate rich, informative visualizations for your simulation results and data analyses. Get starting with VisIt and Paraview, learn the basics of developing interesting and worthwhile geographic and information visualizations, and try your hand at using some of the latest augmented- and virtual-reality tools for manipulating and exploring you visualizations.

For more information and to register please visit:
https://www.tacc.utexas.edu/education/institutes/visualizing-and-interacting-with-data

Data and Information Analytics

Posted by Jason Allison on May 5, 2017 4:18:13 PM

June 19-23, 2017 Want to gain more insight from your data? Is analyzing datasets too much for your favorite spreadsheet? Considering using machine learning to improve insights? Spend a week with TACC's data analysis experts learning about the latest tools and techniques for analyzing and processing...

June 19-23, 2017

Want to gain more insight from your data? Is analyzing datasets too much for your favorite spreadsheet? Considering using machine learning to improve insights? Spend a week with TACC's data analysis experts learning about the latest tools and techniques for analyzing and processing your Big Data problems. Try your hand at using R, Jupyter notebooks, Hadoop, and Spark with guided hands-on exercises, spend time one-on-one with our data analysis staff talking about your own projects and goals, and hear about the latest tools and research in Big Data.

For more information and to register please visit:
https://www.tacc.utexas.edu/education/institutes/data-and-information-analytics

Courses on Manycore Programming (KNL)

Posted by Jason Allison on May 4, 2017 4:33:29 PM

On June 2nd, 2017; TACC will be offering a morning introductory course and an afternoon advanced course on Manycore concepts (KNL). You are welcome to register for either or both courses. Both of the courses are available to in-person and webcast participants. Local participants are strongly...

On June 2nd, 2017; TACC will be offering a morning introductory course and an afternoon advanced course on Manycore concepts (KNL).

You are welcome to register for either or both courses. Both of the courses are available to in-person and webcast participants. Local participants are strongly encouraged to attend in person. For details on course content and for access to register for these courses, please visit the following link:
https://portal.tacc.utexas.edu/training#/user?training=upcoming

Big Data Analysis Training Series

Posted by Jason Allison on Mar 28, 2017 2:58:55 PM

TACC will be offering the following courses as a series in Big Data Analysis. Introduction To Hadoop And Spark On Wrangler - April 20, 2017 Introduction To Scala/Spark - April 27, 2017 Data Analysis Using Hadoop/Spark - May 4, 2017 This training series will cover an introduction to the Big Data...

Updated on May 2, 2017 12:37:22 PM

We still have a few spaces available for in person registration for Data Analysis Using Hadoop/Spark on May 4, 2017 11am - 4pm CT.  Please register ASAP to avoid missing out on this opportunity.

Original Posting

TACC will be offering the following courses as a series in Big Data Analysis.

Introduction To Hadoop And Spark On Wrangler - April 20, 2017
Introduction To Scala/Spark - April 27, 2017
Data Analysis Using Hadoop/Spark - May 4, 2017

This training series will cover an introduction to the Big Data processing platforms, programming models as well as libraries and tools that are specifically designed for data-driven analysis. Each course will be three and a half hours long with approximately three hours of lecture and a half hour of hands-on practice.

Participants are strongly encouraged to sign up for all three courses, as each session will be built on topics from the previous sessions. That stated, participants can also choose only those courses that are best suited for their interest and knowledge level.

Please visit the following link for more information and to register:

https://portal.tacc.utexas.edu/training#/user?training=upcoming

Wrangler Maintenance 2 May 2017

Posted by Jacob Getz on May 1, 2017 10:05:20 AM

Wrangler will not be available from 8 a.m. to 12:00 p.m on Tuesday, May 2nd, 2017. System maintenance and general updates  will be performed during this time.

Thank you.

- TACC Team

Updated on May 1, 2017 1:28:11 PM

We will be moving this maintenance to 5/9 at 8am-12pm and cancelling the maintenance for Wrangler on 5/2 at 8am to 12pm.


-TACC Team

Original Posting

Wrangler will not be available from 8 a.m. to 12:00 p.m on Tuesday, May 2nd, 2017. System maintenance and general updates  will be performed during this time.

Thank you.

- TACC Team

Scaling to Petascale Institute - June 26-30, 2017

Posted by Jason Allison on Apr 19, 2017 11:50:10 AM

Do you have a computational problem that would benefit from using a large scale computing system? Do you need to scale your simulation or data analysis to a petascale system? Registration is now open for the “Scaling to Petascale Institute” to be held June 26-30, 2017. Details are at...

Do you have a computational problem that would benefit from using a large scale computing system?

Do you need to scale your simulation or data analysis to a petascale system?

Registration is now open for the “Scaling to Petascale Institute” to be held June 26-30, 2017. Details are at https://bluewaters.ncsa.illinois.edu/petascale-summer-institute

This institute is for people developing, modifying and supporting research projects who seek to enhance their knowledge and skills to scale software to petascale and emerging extreme scale computing systems. Participants should have familiarity with Linux, programming in Fortran, C, C++, Python or similar language, and familiarity with MPI (message passing interface). There will be hands-on activities for many of the sessions.

Presentations will be made by faculty and professionals from Argonne Leadership Computing Facility (ALCF), the Blue Waters project at the National Center for Supercomputing Applications (NCSA), National Energy Research Scientific Computing Center (NERSC), Oak Ridge Leadership Computing Facility (OLCF), Stony Brook University, and the Texas Advanced Computing Center (TACC).

The agenda will address the following topics.

MPI - Introduction and Advanced topics
OpenMP
Scaling, code profiling, and debugging
GPU programming
OpenACC
Phi programming
Software libraries
Parallel I/O
HDF5
Globus
Software engineering

Wrangler Status 4/16/2017

Posted by Lucas Nopoulos on Apr 16, 2017 11:43:17 AM

Filesystem /gpfs/flash is unavailable on Wrangler due to issues with the Flash storage servers. We are working to resolve this.


--TACC Team 

Updated on Apr 16, 2017 12:58:08 PM

Filesystem /gpfs/flash has been restored on Wrangler. Please submit a ticket for any issues with jobs that were running using that filesystem


--TACC Team

Original Posting

Filesystem /gpfs/flash is unavailable on Wrangler due to issues with the Flash storage servers. We are working to resolve this.


--TACC Team 

Wrangler status April 14 2017

Posted by David Littrell on Apr 14, 2017 11:16:16 PM

Wrangler's gpfs filesystem is currently unavailable from the login node. If you need to access your files then run an idev session to a compute node and find them there. We will resolve this issue as quickly as possible.

Updated on Apr 15, 2017 10:11:22 AM

Wrangler's gpfs filesystem is restored on the login node.


Thanks,
TACC Team

Original Posting

Wrangler's gpfs filesystem is currently unavailable from the login node. If you need to access your files then run an idev session to a compute node and find them there. We will resolve this issue as quickly as possible.

OpenMP Courses - April 28th, 2017

Posted by Jason Allison on Mar 28, 2017 2:31:20 PM

On April 28th, 2017; TACC will be offering a morning introductory course and an afternoon performance optimization course on OpenMP. The morning course will introduce participants to the OpenMP threading model, and describe the basic constructs necessary to parallelize loops on manycore...

On April 28th, 2017; TACC will be offering a morning introductory course and an afternoon performance optimization course on OpenMP.

The morning course will introduce participants to the OpenMP threading model, and describe the basic constructs necessary to parallelize loops on manycore architectures. Topics covered will include understanding the fork/join threading model, using OpenMP pragmas, and loop parallelization.

The afternoon course will provide an introduction to OpenMP optimization techniques for manycore and vectorized architectures. Topics covered will include using OpenMP’s SIMD directives, configuring OpenMP thread affinity, and changing OpenMP thread scheduling behavior.

You are welcome to register for either or both courses. Both of the courses are available to in-person and webcast participants. Local participants are strongly encouraged to attend in person.

For more details on course content and for access to register for these courses, please visit the following link:

https://portal.tacc.utexas.edu/training#/user?training=upcoming

Wrangler user list announcement 3/25/2017

Posted by Matthew Edeker on Mar 25, 2017 8:20:06 PM

Wrangler experienced issues with the dssd nodes supporting /gpfs/flash filesystem. There were a number of jobs running at the time, many were not using this filesystem so should be unaffected. If your jobs were using /gpfs/flash and have failed because of the outage please submit a ticket and let...

Wrangler experienced issues with the dssd nodes supporting /gpfs/flash filesystem. There were a number of jobs running at the time, many were not using this filesystem so should be unaffected. If your jobs were using /gpfs/flash and have failed because of the outage please submit a ticket and let us know.


Thanks

TACC Team

MPI Foundations I and II

Posted by Jason Allison on Mar 24, 2017 11:15:06 AM

On April 14th, 2017; TACC will be offering a morning and an afternoon course on MPI Foundations. You are welcome to register for either or both courses. Both of the courses are available to in-person and webcast participants. Local participants are strongly encouraged to attend in person. For...

On April 14th, 2017; TACC will be offering a morning and an afternoon course on MPI Foundations.

You are welcome to register for either or both courses. Both of the courses are available to in-person and webcast participants. Local participants are strongly encouraged to attend in person.

For details on course content and for access to register for these courses, please visit the following link:

https://portal.tacc.utexas.edu/training#/user?training=upcoming