CVN software correlator development and its applications Zheng Weimin*, Zhang Juan, Tong Li, Tong Fengxian, Liu Lei, Chen Zhong, Shu Fengchun, Wang Guangli.

Slides:

Advertisements

Similar presentations

SCARIe: Realtime software correlation Nico Kruithof, Damien Marchal.

Advertisements

Next Generation Workshop Chinese VLBI Software Correlator Development and its Applications Zheng Weimin, Yang Yan, Zhang Dong, Chen Zhong, Shu Fengchun,

The CVN Real Time Correlator Zhang Xiuzhong, Chen Zhong Shanghai Astronomical Observatory China 4th e-VLBI Workshop Sydney

PHOTOMOD. Future outlook Aleksey Elizarov Head of Software Development Department, Racurs October 2014, Hainan, China From Imagery to Map: Digital Photogrammetric.

Shanghai Astronomical Observatory 2009 East Asia VLBI Workshop1 A few Astronomical Observations of CVN Wang Weihua Shanghai Astronomical Observatory.

Upgrading Plans of the Chinese SLR Network Upgrading Plans of the Chinese SLR Network Yang FuMin(1), Wu Bin(1), Zhang ZhongPing(1), Guo TangYong(2), Zhao.

Preliminary Results of Laser Ranging to Un-cooperative Targets at Shanghai SLR Station Yang FuMin, Zhang ZhongPing, Chen JuPing, Chen WanZhen, Wu ZhiBo,

ASKAP Central Processor: Design and Implementation Calibration and Imaging Workshop 2014 ASTRONOMY AND SPACE SCIENCE Ben Humphreys | ASKAP Software and.

Autonomous Robotics Team Autonomous Robotics Lab: Cooperative Control of a Three-Robot Formation Texas A&M University, College Station, TX Fall Presentations.

VieVS User Workshop 14 – 16 September, 2011 Vienna SPACECRAFT TRACKING Lucia Plank.

Current mm interferometers Sébastien Muller Nordic ARC Onsala Space Observatory Sweden Turku Summer School – June 2009.

Astronomical GRID Applications at ESAC Science Archives and Computer Engineering Unit Science Operations Department ESA/ESAC.

Electronic Transmission of Very- Long Baseline Interferometry Data National Internet2 day, March 18, 2004 David LapsleyAlan Whitney MIT Haystack Observatory,

2012 DiFX user’s meeting, Sydney, Australia USNO Software Correlator: Status Report Outline USNO/WACO Background USNO Prototype Software Correlator (UPSC)

Current LBA Developments Chris Phillips CSIRO ATNF 13/7/2005.

P ulsa R E xploration and S earch TO Jintao Luo NRAO-CV CREDIT: Bill Saxton, NRAO/AUI/NSF.

Brief introduction of YINGHUO-1 Micro-satellite for Mars environment exploration J. Wu, G. Zhu, H. Zhao, C. Wang, L. Lei, Y. Sun, W. Guo and S. Huang Center.

1b.1 Types of Parallel Computers Two principal approaches: Shared memory multiprocessor Distributed memory multicomputer ITCS 4/5145 Parallel Programming,

Sobolev Showcase Computational Mathematics and Imaging Lab.

上海天文台 Shanghai Astronomical Observatory e-VLBI Progress in China Zhang Xiuzhong, team of Chinese VLBI Network Shanghai Astronomical Observatory Chinese.

1 First Results of the CMONOC GNSS Network Junping Chen Bin Wu, Shuhua Ye, Shanghai Astronomical Observatory

上海天文台 Shanghai Astronomical Observatory Recent VLBI Activities in China Zhi-Qiang Shen (Shanghai Astronomical Observatory) 2009 East Asia VLBI Workshop.

Radio Astronomy Applications Group Kashima Space Research Center National Institute of Information and Communications Technology EGU2005 GI1-1TH5P-0026.

1 AOGS 2012, Singapore, Aug 13-17, 2012 Surveying co-located GNSS/VLBI/SLR Stations In China Xiuqiang Gong, Yunzhong Shen, Junping Chen, Bin Wu Shanghai.

E-VLBI over TransPAC Masaki HirabaruDavid LapsleyYasuhiro KoyamaAlan Whitney Communications Research Laboratory, Japan MIT Haystack Observatory, USA Communications.

SVY 207: Lecture 13 Ambiguity Resolution

Real Time Correlator in FPGA Xu ZhiJun, Zhang XiuZhong Shanghai Astronomical Observatory China 4 th IVS General Meeting January 9, 2006.

Nov 3, 2009 RN - 1 Jet Propulsion Laboratory California Institute of Technology Current Developments for VLBI Data Acquisition Equipment at JPL Robert.

Status and future of East Asia VLBI network H.Kobayashi(NAOJ) East Asia VLBI

GPS: Everything you wanted to know, but were afraid to ask Andria Bilich National Geodetic Survey.

DiFX Performance Testing Chris Phillips eVLBI Project Scientist 25 June 2009.

An FX software correlator for VLBI Adam Deller Swinburne University Australia Telescope National Facility (ATNF)

Update on the Software Correlator Nico Kruithof, Huseyin Özdemir, Yurii Pydoprihora, Ruud Oerlemans, Mark Kettenis, JIVE.

上海天文台 Shanghai Astronomical Observatory 4th IVS General Meeting Spacecraft Tracking with Chinese VLBI Network Xiuzhong Zhang and Chinese VLBI Network Team.

Chinese Real Time VLBI Correlator Xiang Ying, Xu Zhijun, Zhu Renjie, Zhang Xiuzhong, Shu Fengchun, Zheng Weimin Shanghai Astronomical Observatory China.

18-19 July, 2002Correlator Backend System OverviewTom Morgan 1 Correlator Backend System Overview Tom Morgan, NRAO.

DiFX New Features. Disk based file specification Improved specification of files to correlate Wild cards with time of scan name filtering? External reference.

Sep. 17, 2002BESIII Review Meeting BESIII DAQ System BESIII Review Meeting IHEP · Beijing · China Sep , 2002.

Distributed FX software correlation Adam Deller Swinburne University/CSIRO Australia Telescope National Facility Supervisors: A/Prof Steven Tingay, Prof.

Pulsar tools in DiFX Adam Deller ASTRON 6th DiFX workshop, CSIRO ATNF, Sydney AUS.

Review of developments in Australasia and mainland Asia Steven Tingay Swinburne University of Technology Next Generation correlator meeting, JIVE 27 -

A real-time software backend for the GMRT : towards hybrid backends CASPER meeting Capetown 30th September 2009 Collaborators : Jayanta Roy (NCRA) Yashwant.

Demonstration of 16Gbps/station broadband-RF VLBI system Alan Whitney for the VLBI2010 development team MIT Haystack Observatory 22 October st Intl.

1 SVY 207: Lecture 12 Modes of GPS Positioning Aim of this lecture: –To review and compare methods of static positioning, and introduce methods for kinematic.

The DiFX software correlator DiFX is an FX style correlator written in C++ Designed to run on commodity clusters Optimised Intel vector libraries are used.

上海天文台 Shanghai Astronomical Observatory VLBI correlators of Shanghai Astronomical Observatory ZHENG Weimin, Zhang Xiuzhong Shanghai Astronomical Observatory,

SHA: the GNSS Analysis Center at SHAO Junping Chen, Bin Wu, Xiaogong Hu Haojun Li, Xiao Pei, Yize Zhang Shanghai Astronomical Observatory (SHAO)

WHAT ARE SATELLITES AND SPACE PROBES? Objective: Explain how artificial satellites and space probes are used to explore space. Key Terms: Satellite orbit.

Possible eVLBI connection between Eastern Asian Observatories Noriyuki KAWAGUCHI National Astronomical Observatory, Japan eVLBI Workshop

上海天文台 Shanghai Astronomical Observatory CVN in Chang’e-3 lunar exploration mission ZHENG Weimin Shanghai Astronomical Observatory, Chinese.

What is FABRIC? Future Arrays of Broadband Radio-telescopes on Internet Computing Huib Jan van Langevelde, JIVE Dwingeloo.

VGOS GPU Based Software Correlator Design Igor Surkis, Voytsekh Ken, Vladimir Mishin, Nadezhda Mishina, Yana Kurdubova, Violet Shantyr, Vladimir Zimovsky.

Sobolev(+Node 6, 7) Showcase +K20m GPU Accelerator.

RFI Protection Activities in IAA RAS

Korea Astronomy and Space Science Institute

Parallel Plasma Equilibrium Reconstruction Using GPU

RFI Protection Activities in IAA RAS

VLBI in China and the Collaboration with NL

Searching FRB with Jiamusi-66m Radio Telescope

Geodetic VLBI activities in China

The Development of Broadband VLBI Technologies in SHAO

NRAO-GB Support for VSOP-2

Observational Astronomy

Observational Astronomy

After School Astronomy Clubs Dorian Janney

Shanghai VLBI Center Activities

Recent VLBI Activities at XAO

User interaction and workflow management in Grid enabled e-VLBI experiments Dominik Stokłosa Poznań Supercomputing and Networking Center, Supercomputing.

Planetary Radio Interferometry and Doppler Experiment (PRIDE)

Types of Parallel Computers

Presentation transcript:

CVN software correlator development and its applications Zheng Weimin*, Zhang Juan, Tong Li, Tong Fengxian, Liu Lei, Chen Zhong, Shu Fengchun, Wang Guangli Shanghai Astronomical Observatory, Chinese Academy of Sciences 8th East Asia VLBI workshop, Sapporo, Japan July,

Outline 1.Development history 2.Applications in CE-3 mission 3.Development status 4.Future work 2 CVN software correlator

1. Development history First CVN software correlator: Satellite Fringe searcher Matlab First domestic Geostationary, Elliptical Orbit Satellites VLBI correlation FX type software correlator for Chinese Lunar Exploration Project (CE-1) c language ESA SMART-1, TC-1, TC-2 VLBI tracking experiment Hardware correlator debugger & backup in CE-1 preparation stage SMP parallelization 3CVN software correlator

Primary CVN correlator in CE-1, CE-2 lunar projects Near real time correlator, with satellite fringe search ability Data latency < 2min VLBI center latency ~ 6min Primary correlator in CE-3, CE-5T1 projects Real time correlation & satellite fringe search ability MPI + OpenMP parallelization Data latency < 10sec VLBI center latency < 40sec CVN Geodesy application of Crustal Movement Observation Network of China (CMONOC ) 4CVN software correlator

Outline 1.Development history 2.Applications in CE-3 mission 3.Development status 4.The future work 5 CVN software correlator

CE-3 Mission objective:  Complete the Chinese first soft-landing and roving exploration on the Moon (first probe to soft-land on the Moon since Luna 24 in 1976)  Demonstrate and develop key technologies for future missions.  Scientific objectives: Lunar surface topography, lunar surface material composition and resource survey, lunar-based astronomical observation, etc Applications in CE-3 mission

New Requirements & techniques of CVN 1.High accuracy 2.Real time ability 3.Accurate Moon surface positioning 4.Combined orbit determination ( X band ΔDOR ) DOR – Differential of One-way Range ( e-VLBI + real time data process pipleline) (Same Beam VLBI, SBI ) (2-way/ 3-way range + VLBI) 7

Mission Requirements on VLBI 1.Earth-Moon transfer orbit phase & circumlunar phase  ΔDOR tracking group delay < 4ns (Actuality <0.5ns)  Orbit & angular determination and orbit prediction ；  System data processing latency < 1minute (Actuality 15~40 seconds) 2.Lunar surface working phase  Lander & Rover tracking by SBI  Lander 3D position <1km (Actuality <100m )  Rover relative position of the lander <500m (Actuality ~1m ) 8

CVN data center real-time pipelines in CE-3

Block diagram software correlator NFS: Network File System

Computing platform Standard Linux cluster Five I/O nodes - E7-4820*4/ 128GB/ 300GB+12TB 32 compute nodes*12 cores fringe search + correlation - E5-2640*2/ 32GB/ 300GB 2 manage nodes - E5-2620*2/ 24GB/ 900GB+214GB Management network - 10G Ethernet Compute network - InfiniBand 11

Specifications of CE-3 software correlator 12 Processing ModeReal-time & post-processing Station number1~20 Real-time fast fringe search4 stations IF number1,2,4,8,16 Frequency channel24~16384/IF Integration period0.1~60 second Maximum data speed (192 CPU cores) About 1.9Gbps/station, totally 4 stations Output formatCVN, FITS-IDI

13 Rover positioning by same-beam VLBI 1.Differenced VLBI group delay Real time mode 2.Same beam phase reference image postprocess mode 3.Differenced VLBI phase delay, postprocess

Null test by same beam phase reference image positioning Local coordinateNorthEastDownDistance Same-beam phase- referencing VLBI result True value Differences Null test error: ~ 0.6 m

Rover A B C D E E17 15

Outline 1.Development history 2.Applications in CE-3 mission 3.Development status 4.The future work 16 CVN software correlator

3. Development status Increase correlation speed by MPI+Pthreads 6 stations * 1.1Gbps/station->2.0Gbps/station 192 CPU cores GPU acceleration: VGOS application Geodesy application: Output format CVN--> Mk4, Pulsar gate : Pulsar processing 17CVN software correlator

Via DiFX software package – cvn2difx: developed by our group – difx2mark4: provided by DiFX Direct convert – cvn2mark4: under development CVN visibility output delay model cvn2difx DiFX SWIN format.im file.input,.calc,.flag difx2mark4 Mark4 format type-0 (root) type-1 (corel) type-3 (station).vex vex2difx CVN visibility output delay model cvn2mark4 Mark4 format type-0 (root) type-1 (corel) type-3 (station).vex CVN to Mark4 format transform test

CVNDiFX

DiFX vs. CVN SC

Two GPU Nodes Each node:1 x Nvidia K40c GPU Workstation DELL T5600 ChipsetIntel C600 CPUIntel 2.00GHz Memory 64GB Ethernet Intel Gb NIC InfinibandMellonax ConnectX 40Gb/s QDR GPUNVIDIA Kepler K40c GPU acceleration correlator prototype

CE-3 DOR delay difference: GPU SC vs. CPU SC GPU Speed/station 1 node 337Mbps 2 nodes670Mbps Four station speed test NVIDA K40C

20s integration without pulsar gate and dispersion correction Pulsar B preliminary result 20s integration with pulsar gate and dispersion correction

4. Future work CVN needs a general purpose software correlator: Lunar and deep space exploration mission Geodesy and astronomy data processing Pulsar binning, multi-phase center ability VGOS broadband ability New software correlator CVN, IVS(VGOS), EVAN, AOV CVN software correlator24

Thank you for your attention!

Rover position （ 4 ways ） Site Visual+ Inertial navigation VLBI group delay VLBI phase delay VLBI phase reference map A N E B N E C N E D N E E N m E E17 N-11.83/ / E-13.05/ /

Residual statistics  VLBI group delay residuals ： ~ 1ns in trans-lunar orbit ~ 0.5ns in lunar orbit.

The Software Correlator Status of CVNSlide#: 28 Fast fringe search is closed! Fast fringe search is opened! The result of CVN software correlator using the fast fringe search function. The show tool is real-time monitoring tool developed by ourselves.

Perilune braking real time fringe search result