Skip to content

Commit b01153b

Browse files
authored
Black hole and Gravitational waves case studies (#160)
Closes gh-82.
1 parent db8309f commit b01153b

13 files changed

+163
-0
lines changed

config.yaml

+4
Original file line numberDiff line numberDiff line change
@@ -119,6 +119,8 @@ languages:
119119
url: /nl/doc
120120
- title: Array computing
121121
url: /nl/arraycomputing
122+
- title: Case Studies
123+
url: /nl/case-studies/blackhole-image
122124
- title: Learn
123125
url: /nl/learn
124126
- title: Community
@@ -181,6 +183,8 @@ languages:
181183
url: /hi/doc
182184
- title: Array computing
183185
url: /hi/arraycomputing
186+
- title: Case Studies
187+
url: /hi/case-studies/blackhole-image
184188
- title: Learn
185189
url: /hi/learn
186190
- title: Community
+62
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,62 @@
1+
---
2+
title: "Case Study: The First Image of a Black Hole"
3+
sidebar: false
4+
---
5+
6+
{{< figure src="/images/content_images/cs/blackhole.jpg" caption="**Black Hole M87**" alt="black hole image" attr="(**Image Credits:** Event Horizon Telescope Collaboration)" attrlink="https://www.jpl.nasa.gov/images/universe/20190410/blackhole20190410.jpg" >}}
7+
8+
<blockquote cite="https://www.youtube.com/watch?v=BIvezCVcsYs">
9+
<p>Imaging the M87 Black Hole is like trying to see something that is by definition impossible to see.</p>
10+
<footer align="right">—Katie Bouman, <cite>Assistant Professor, Computing & Mathematical Sciences, Caltech</cite></footer>
11+
</blockquote>
12+
13+
## About Event Horizon Telescope
14+
15+
The [Event Horizon telescope (EHT)](https://eventhorizontelescope.org), is an array of eight ground-based radio telescopes forming a computational telescope the size of the earth, that are designed to study extreme objects in the universe, with unprecedented sensitivity and resolution. It is a worldwide network of eight pre-existing telescopes based on a technique called very-long-baseline interferometry (VLBI). This technique is used to synchronize these telescopes deployed across the globe to form one huge, Earth-size telescope capable of observing at a wavelength of 1.3 mm. This means EHT can achieve an angular resolution of [20 micro-arcseconds](https://eventhorizontelescope.org/press-release-april-10-2019-astronomers-capture-first-image-black-hole) — enough to read a newspaper in New York from a sidewalk café in Paris!
16+
17+
### Key Imaging Objectives
18+
19+
* To study the most extreme objects in the Universe predicted by Einstein’s theory of general relativity, during the centennial year of the historic experiment that first confirmed the theory (2017).
20+
21+
* Focus on the [black hole](https://solarsystem.nasa.gov/resources/2319/first-image-of-a-black-hole/) at the center of Messier 87 galaxy, located in the Virgo galaxy cluster. This black hole resides approximately 55 million light-years from Earth and has a mass equal to 6.5 billion times that of the Sun. It has been a subject of astronomical study for [over a 100 years](https://www.jpl.nasa.gov/news/news.php?feature=7385). Black holes have been theoretically predicted and observed but a real image was never created until now.
22+
23+
* Based on Einstein’s general theory of relativity, the scientists expected to see a dark region similar to a shadow, caused by the gravitational bending and capture of light by the event horizon. By studying this shadow scientists could measure the enormous mass of M87’s black hole.
24+
25+
### The Challenges
26+
27+
* **Scale**
28+
29+
The observations from Event Horizon Telescope (EHT) present challenges for existing data processing tools, arising from the rapid atmospheric phase fluctuations, wide recording bandwidth, and highly heterogeneous array.
30+
31+
* **Calibration and Correlation**
32+
33+
Besides scheduling all of these coordinated observations of EHT, reducing the overall volume and complexity of data to aid analysis is a really hard problem to solve. To put things in perspective, EHT generates over 350 Terabytes worth of observed data per day, stored on high-performance helium filled hard drives.
34+
35+
* **Source Imaging and Model Fitting**
36+
37+
The sequence of correlation and engineering releases represents a year-long effort of identifying and mitigating data issues, and developing new software and procedures that could reliably choose the most likely image based on actual measurements.
38+
39+
{{< figure src="/images/content_images/cs/dataprocessbh.png" class="csfigcaption" caption="**EHT Data Processing Pipeline**" alt="data pipeline" align="middle" attr="(Diagram Credits: The Astrophysical Journal, Event Horizon Telescope Collaboration)" attrlink="https://iopscience.iop.org/article/10.3847/2041-8213/ab0c57" >}}
40+
41+
## NumPy’s Role in Black Hole Imaging
42+
43+
There are several aspects to black hole imaging besides data collection, noise elimination, data cleanup, reduction and correlation. Imaging is crucial as it can help to predict not only the black hole mass but also rule out whether a black hole could be a wormhole, a theoretical bridge between distant points in spacetime. But it is also incredibly hard to measure given the astronomical distances involved. As Katie Bouman mentions in her [TED talk](https://www.youtube.com/watch?v=BIvezCVcsYs), ‘It is like taking a picture of an orange on the surface of the moon.’
44+
45+
{{< figure src="/images/content_images/cs/bh_numpy_role.png" class="fig-center" alt="role of numpy" caption="**The role of NumPy in Black Hole imaging**" >}}
46+
47+
Once the key challenges posed by EHT, data collection and reduction are taken care of, the next big challenge in data processing is related to imaging. The imaging algorithms form the core of this task as through imaging, scientists could calculate the shadow of the black hole which forms the crux of several other calculations related to event horizon and nearby objects. One of the key algorithms used in imaging was developed by Katie Bouman – Continuous High-resolution Image Reconstruction using Patch priors, or ‘CHIRP’. It can parse the cumulative telescope data gathered by the Event Horizon Telescope project.For imaging tasks, researchers banked on Python to run the datasets on these algorithms, arraying and plotting data for meaningful insights.
48+
49+
Besides NumPy, there were other packages such as [SciPy](https://www.scipy.org), [Pandas](https://pandas.io) and [Matplotlib](https://matplotlib.org) that helped in imaging and [data processing for imaging the black hole](https://iopscience.iop.org/article/10.3847/2041-8213/ab0c57). The standard astronomical file formats and time/coordinate transformations were handled by [Astropy](https://www.astropy.org) while Matplotlib was used in visualizing data throughout the analysis pipeline, including the generation of the final image of the black hole.
50+
51+
Andrew Chael and the ehtim project team came up with [eht-imaging](https://github.com/achael/eht-imaging) Python modules for simulating and manipulating VLBI data and producing images with regularized maximum likelihood methods. NumPy is at the core of array data processing used in this software package named ehtim as indicated by the partial software dependency chart below.
52+
53+
{{< figure src="/images/content_images/cs/ehtim_numpy.png" class="fig-center" alt="ehtim dependency map highlighting numpy" caption="**Software dependency chart of ehtim package highlighting NumPy**" >}}
54+
55+
The challenge posed during reconstruction of an image using VLBI measurements is that there can be an infinite number of possible images that explain the data. The ehtim software addresses this challenge by implementing algorithms that help find a set of most likely reasonable images that respects prior scientific assumptions while still satisfying the observed data.
56+
57+
58+
## Summary
59+
60+
NumPy enabled researchers to manipulate large numerical datasets through its efficient data structures of vectors and matrices leading to imaging and plotting of the first ever image of a black hole. Imaging of M87 black hole is a major scientific feat that was almost presumed impossible a century ago. In a way, black hole image has helped in a stunning confirmation of Einstein’s general theory of relativity. This is not only a breakthrough in technology, but an example of international scale collaboration that uses connections between the world's best radio observatories, over 200 scientists worked with observations collected over 10 days and analyzed for over a year. They used innovative algorithms and data processing techniques improving upon existing astronomical models to help unfold some of the mysteries of the universe.
61+
62+
{{< figure src="/images/content_images/cs/numpy_bh_benefits.png" class="fig-center" alt="numpy benefits" caption="**Key NumPy Capabilities utilized**" >}}

content/en/case-studies/gw-discov.md

+62
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,62 @@
1+
---
2+
title: "Case Study: Discovery of Gravitational Waves"
3+
sidebar: false
4+
---
5+
6+
{{< figure src="/images/content_images/cs/gw_sxs_image.png" class="fig-center" caption="**Gravitational Waves**" alt="binary coalesce black hole generating gravitational waves" attr="(**Image Credits: The Simulating eXtreme Spacetimes (SXS) Project at LIGO** )" attrlink="https://youtu.be/Zt8Z_uzG71o" >}}
7+
8+
<blockquote cite="https://www.youtube.com/watch?v=BIvezCVcsYs">
9+
<p>The scientific Python ecosystem is critical infrastructure for the research done at LIGO.</p>
10+
<footer align="right">David Shoemaker, <cite>LIGO Scientific Collaboration</cite></footer>
11+
</blockquote>
12+
13+
## About [Gravitational Waves](https://www.nationalgeographic.com/news/2017/10/what-are-gravitational-waves-ligo-astronomy-science/) and [LIGO](https://www.ligo.caltech.edu)
14+
15+
Gravitational waves are ripples in the fabric of space and time, generated by cataclysmic events in the universe such as collision and merging of two black holes or coalescing binary stars or supernovae. Observing GW can not only help in studying gravity but also in understanding some of the obscure phenomena in the distant universe and its impact.
16+
17+
The [Laser Interferometer Gravitational-Wave Observatory (LIGO)](https://www.ligo.caltech.edu) was designed to open the field of gravitational-wave astrophysics through the direct detection of gravitational waves predicted by Einstein’s General Theory of Relativity. It comprises two widely-separated interferometers within the United States—one in Hanford, Washington and the other in Livingston, Louisiana—operated in unison to detect gravitational waves. Each of them has multi-kilometer-scale gravitational wave detectors that use laser interferometry. The LIGO Scientific Collaboration (LSC), is a group of more than 1000 scientists from universities around the United States and in 14 other countries supported by more than 90 universities and research institutes; approximately 250 students actively contributing to the collaboration. The new LIGO discovery is the first observation of gravitational waves themselves, made by measuring the tiny disturbances the waves make to space and time as they pass through the earth. It has opened up new astrophysical frontiers that explore the warped side of the universe—objects and phenomena that are made from warped spacetime.
18+
19+
20+
### Key Objectives
21+
22+
* Though its [mission](https://www.ligo.caltech.edu/page/what-is-ligo) is to detect gravitational waves from some of the most violent and energetic processes in the Universe, the data LIGO collects may have far-reaching effects on many areas of physics including gravitation, relativity, astrophysics, cosmology, particle physics, and nuclear physics.
23+
* Crunch observed data via numerical relativity computations that involves complex maths in order to discern signal from noise, filter out relevant signal and statistically estimate significance of observed data
24+
* Data visualization so that the binary / numerical results can be comprehended.
25+
26+
27+
### The Challenges
28+
29+
* **Computation**
30+
31+
Gravitational Waves are hard to detect as they produce a very small effect and have tiny interaction with matter. Processing and analyzing all of LIGO's data requires a vast computing infrastructure.After taking care of noise, which is billions of times of the signal, there is still very complex relativity equations and huge amounts of data which present a computational challenge: [O(10^7) CPU hrs needed for binary merger analyses](https://youtu.be/7mcHknWWzNI) spread on 6 dedicated LIGO clusters
32+
33+
* **Data Deluge**
34+
35+
As observational devices become more sensitive and reliable, the challenges posed by data deluge and finding a needle in a haystack rise multi-fold. LIGO generates terabytes of data every day! Making sense of this data requires an enormous effort for each and every detection. For example, the signals being collected by LIGO must be matched by supercomputers against hundreds of thousands of templates of possible gravitational-wave signatures.
36+
37+
* **Visualization**
38+
39+
Once the obstacles related to understanding Einstein’s equations well enough to solve them using supercomputers are taken care of, the next big challenge was making data comprehensible to the human brain. Simulation modeling as well as signal detection requires effective visualization techniques. Visualization also plays a role in lending more credibility to numerical relativity in the eyes of pure science aficionados, who did not give enough importance to numerical relativity until imaging and simulations made it easier to comprehend results for a larger audience. Speed of complex computations and rendering, re-rendering images and simulations using latest experimental inputs and insights can be a time consuming activity that challenges researchers in this domain.
40+
41+
{{< figure src="/images/content_images/cs/gw_strain_amplitude.png" class="fig-center" alt="gravitational waves strain amplitude" caption="**Estimated gravitational-wave strain amplitude from GW150914**" attr="(**Graph Credits:** Observation of Gravitational Waves from a Binary Black Hole Merger, ResearchGate Publication)" attrlink="https://www.researchgate.net/publication/293886905_Observation_of_Gravitational_Waves_from_a_Binary_Black_Hole_Merger" >}}
42+
43+
## NumPy’s Role in the detection of Gravitational Waves
44+
45+
Gravitational waves emitted from the merger cannot be computed using any technique except brute force numerical relativity using supercomputers. The amount of data LIGO collects is as incomprehensibly large as gravitational wave signals are small.
46+
47+
NumPy, the standard numerical analysis package for Python, was utilized by the software used for various tasks performed during the GW detection project at LIGO. NumPy helped in solving complex maths and data manipulation at high speed. Here are some examples:
48+
49+
* [Signal Processing](https://www.uv.es/virgogroup/Denoising_ROF.html): Glitch detection, [Noise identification and Data Characterization](https://ep2016.europython.eu/media/conference/slides/pyhton-in-gravitational-waves-research-communities.pdf) (NumPy, scikit-learn, scipy, matplotlib, pandas, pyCharm )
50+
* Data retrieval: Deciding which data can be analyzed, figuring out whether it contains a signal - needle in a haystack
51+
* Statistical analysis: estimate the statistical significance of observational data, estimating the signal parameters (e.g. masses of stars, spin velocity, and distance) by comparison with a model.
52+
* Visualization of data
53+
- Time series
54+
- Spectrograms
55+
* Compute Correlations
56+
* Key [Software](https://github.com/lscsoft) developed in GW data analysis such as [GwPy](https://gwpy.github.io/docs/stable/overview.html) and [PyCBC](https://pycbc.org) uses NumPy and AstroPy under the hood for providing object based interfaces to utilities, tools and methods for studying data from gravitational-wave detectors.
57+
58+
## Summary
59+
60+
GW detection has enabled researchers to discover entirely unexpected phenomena while providing new insight into many of the most profound astrophysical phenomena known. Number crunching and data visualization is a crucial step that helps scientists gain insights into data gathered from the scientific observations and understand the results. The computations are complex and cannot be comprehended by humans unless it is visualized using computer simulations that are fed with the real observed data and analysis. NumPy along with other Python packages such as matplotlib, pandas and scikit-learn is [enabling researchers](https://www.gw-openscience.org/events/GW150914/) to answer complex questions and discover new horizons in our understanding of the universe.
61+
62+
{{< figure src="/images/content_images/cs/numpy_gw_benefits.png" class="fig-center" alt="numpy benefits" caption="**Key NumPy Capabilities utilized**" >}}

layouts/partials/single/content.html

+1
Original file line numberDiff line numberDiff line change
@@ -16,4 +16,5 @@ <h5 class="subtitle is-5 is-muted">{{ .Params.Subtitle }}</h5>
1616
</div>
1717
{{ .Content }}
1818
</div>
19+
</div>
1920
</section>

static/css/styles.css

+34
Original file line numberDiff line numberDiff line change
@@ -250,6 +250,40 @@ p {
250250
font-size: 12px;
251251
}
252252

253+
figcaption {
254+
text-align: center;
255+
}
256+
257+
.csfigcaption {
258+
text-align: center;
259+
}
260+
261+
.fig-center {
262+
text-align: center;
263+
display: block;
264+
margin-left: auto;
265+
margin-right: auto;
266+
width: 80%;
267+
}
268+
269+
blockquote {
270+
margin: 10px;
271+
}
272+
273+
blockquote p {
274+
padding: 15px;
275+
background: #eee;
276+
border-radius: 5px;
277+
}
278+
279+
blockquote p::before {
280+
content: '\201C';
281+
}
282+
283+
blockquote p::after {
284+
content: '\201D';
285+
}
286+
253287
@media only screen and (max-width: 1150px) {
254288
.sign-up-input {
255289
font-size: 12px;
Loading
27.6 KB
Loading
Loading
Loading
Loading
Loading
Loading
Loading

0 commit comments

Comments
 (0)