1. Semiconductor Manufacturing (and other stuff) with Condor
March 2005
Condor Week 2005
Semiconductor Manufacturing (and other stuff) with Condor
Brooklin J. Gore
Senior Fellow, Advanced Computing
2003 Micron Technology, Inc. All rights reserved. Information is subject to change without notice. 1 1

2. Condor at Micron Agenda
Introductions
Micron’s Grid Environment
Grid Applications
Current Activities
Challenges
11/17/2018
Micron Confidential

3. Condor at Micron Introductions
2nd largest global maker of DRAM
Plus CMOS Cameras and FLASH
You
Team Condor? Collaborators? Users?
First Timers?
11/17/2018
Micron Confidential

4. Condor at Micron Overview of Micron’s Grid
10k+ processors in 11 “pools”
Linux, Solaris, Windows
~29th Top500 Rank
4.2 TeraFLOPS
Built in-house
Open Source Grid
Centralized governance
Distributed management
16+ applications
Self developed
Micron’s Global Grid
11/17/2018
Micron Confidential

5. Condor at Micron Overview of Micron’s Grid: Global Status
11/17/2018
Micron Confidential

6. Condor at Micron Overview of Micron’s Grid: Pool Home
11/17/2018
Micron Confidential

7. Condor at Micron Overview of Micron’s Grid: Pool Status
11/17/2018
Micron Confidential

8. Condor at Micron Overview of Micron’s Grid: Host Manager
11/17/2018
Micron Confidential

9. Condor at Micron Overview of Micron’s Grid: Job Manager
11/17/2018
Micron Confidential

10. Condor at Micron Overview of Micron’s Grid: User Manager
11/17/2018
Micron Confidential

11. Condor at Micron Overview of Micron’s Grid: Pool Metrics
11/17/2018
Micron Confidential

12. Condor at Micron Overview of Micron’s Grid: Windows Hosts
Condor_wingmr:
Runs every hour via STARTD CRON
Provides user login status
Lists installed software
Manages pool membership
The ‘homeless’ pool
Checks credential quality
Micron Custom Machine ClassAd Attributes
11/17/2018
Micron Confidential

13. Condor at Micron Grid Applications
Manufacturing applications (widget processing)
Engineering applications (repetitive tasks)
Reporting applications (chart generation)
Data mining (log file processing)
Software development (testing, packaging)
Security (proactive port scanning)
Grid-enabled script engines (MATLAB, JMP, R, etc.)
11/17/2018
Micron Confidential

14. Condor at Micron Current Activities
Latest Condor slam dunk: Imager (re)testing/development
2.37 million images (690 GB compressed data) in 11 hours
100 concurrent jobs (231 unique hosts), 90% filer utilization
Would have taken 34 days on 1 CPU
May develop portal for this application
In progress: Excel macros
How can something so simple be so hard?
Windows is NOT a multi-user OS (Windows puts the personal in PC)!
Next big thing: Persistent Mobile Processing
Process short but relentless tasks in possibly pipelined work queues with minimum required completion times
11/17/2018
Micron Confidential

15. Condor at Micron Grid Challenges
Windows. Windows. Windows.
Apps, like Excel (use_visual_desktop good, windows user security model bad)
Credentials
Managing big pools (upgrades, host quality, etc.)
App->Resource matching on out-of-band resources:
Database connections
Filer utilization
Software licenses
11/17/2018
Micron Confidential

16. Condor Week 2005 Thank You! Questions?
Micron and the Micron logo are trademarks and/or service marks of Micron Technology, Inc.
All other trademarks are the property of their respective owners.