> ## Content Index > Fetch the complete content index at: https://www.thedigitalspeaker.com/llms.txt > Use this file to discover other available public pages before exploring further. # Shell Drills Deep With Big Data - URL: https://www.thedigitalspeaker.com/shell-drills-deep-with-big-data/ - Published: 2013-03-19T08:10:00.000Z - Updated: 2026-08-04T05:43:00.000Z - Description: Shell uses big data to improve its operations and to increase oil and gas output of their wells and they are creating massive data sets. - Author: Dr Mark van Rijmenam, CSP - Tags: Big Data Increasingly, Shell uses [big data](https://www.thedigitalspeaker.com/big-data-speaker/) to improve its operations and to increase oil and gas output of their wells. Since a couple of years they have started lowering optical fiber cables within their wells. These cables are supplied with sensors that measure everything within the wells. With this data, Shell can improve analysis of how the wells are doing and how much oil or gas is still left. What Shell exactly does with the data and how they interpret it is a secret that Chief Technologist [Gerard Schotman](http://www.shell.com/global/future-energy/innovation/chief-scientists/cto.html?ref=thedigitalspeaker.com) does not want to [share](http://fd.nl/ondernemen/topics/innovatie/349154-1303/shell-wil-hardware-delen-maar-data-niet?ref=thedigitalspeaker.com). However, what is known is that these super-sensitive sensors within the optical fiber cables help Shell find additional oil in wells that were thought to have run dry. These sensors, that were [created](http://www.computerworld.com/s/article/9225827/Shell%5FOil%5Ftargets%5Fhybrid%5Fcloud%5Fas%5Ffix%5Ffor%5Fenergy%5Fsaving%5Fagile%5FIT?ref=thedigitalspeaker.com) by HP, generate massive amounts of data that that is stored at a private isolated section of the Amazon Web Services. Since they started they have already collected 46 petabytes of data and the first test they did in one oil well resulted in 1 petabyte of information. Knowing that they want to deploy those sensors to approximately 10.000 oil wells, we are talking about 10 Exabyte’s of data, or 10 days of all data being created on the internet. Because of these huge datasets, Shell started [piloting](https://www-950.ibm.com/events/wwe/grp/grp037.nsf/vLookupPDFs/RICK%20-%20IDC%5FCalgary%5FBig%5FData%5FOil%5Fand-Gas/$file/RICK%20-%20IDC%5FCalgary%5FBig%5FData%5FOil%5Fand-Gas.pdf?ref=thedigitalspeaker.com) with Hadoop in the Amazon Virtual Private Cloud. All the data is of course impossible to understand correctly if not properly visualized. Therefore, in order to make the data relevant information Shell is working together with IBM and [DreamWorks Hollywood](http://www.dreamworksanimation.com/?ref=thedigitalspeaker.com). An unexpected combination, but one definitely needed to visualize so much data. All data that is received from the seismic sensors are [analysed](http://blogs.wsj.com/cio/2013/01/02/big-oils-big-data-push-changing-the-future-of-energy/?ref=thedigitalspeaker.com) by the artificial intelligence developed by Shell and rendered in 3D and 4D maps of the oil reservoirs. Although the analyses are done in the cloud, the visualizations are immediately available to the crew working at the local factory. At the moment Shell has about 70 people working full-time in the data analysis department at the company, plus hundreds more scattered over the world who participate on an ad hoc basis. The department consists of a mix of specialists in IT, oil and gas technology, mathematicians and physicists. They are all working towards the same goal of getting more oil and gas out of the same, or new, wells. Although Shell refuses to tell how exactly it uses what data, they are doing something remarkable with the data that they do want to share. It is a rare combination of two organisations so far apart: Shell and a few environmental organisations share data. As Gerald Schotman [explains](http://fd.nl/ondernemen/topics/innovatie/349154-1303/shell-wil-hardware-delen-maar-data-niet?ref=thedigitalspeaker.com) “during a brainstorm with environmental organisations we noticed that we can help migratory birds across the Sahara in their search for water. Or we share data with organisations concerning the migration of whales.” It is definitely not a surprise that Shell makes a big effort of big data. They have a lot to win. If they manage to extract 1 percentage-point of extra oil from the wells due to big data, and all oil companies worldwide do this, it would mean additional oil for the entire world for another three years. So, Shell is quite right that they drill deep with big data! ##### *Image Credit:* [*Worldpics/Shutterstock*](https://www.shutterstock.com/g/Worldpics?ref=thedigitalspeaker.com) ## Frequently asked questions ### How does Shell use fiber optic cables in oil wells? Shell lowers optical fiber cables into wells that are fitted with super-sensitive sensors, created by HP, to measure everything happening within the well. This data helps Shell analyze how wells are performing and how much oil or gas remains, and has even helped find additional oil in wells previously thought to have run dry. [Link to this question](#faq-how-does-shell-use-fiber-optic-cables-in-oil-wells) ### How much data has Shell collected from its well sensors? Shell has already collected 46 petabytes of data from its sensors, with a single test in one oil well producing 1 petabyte of information. Since Shell plans to deploy these sensors to approximately 10,000 oil wells, the total could reach 10 exabytes, equivalent to about 10 days of all data created on the internet. [Link to this question](#faq-how-much-data-has-shell-collected-from-its-well-sensors) ### Who helps Shell visualize its oil well data? Shell works together with IBM and DreamWorks Hollywood, an unexpected but necessary partnership, to visualize its massive datasets. Data from seismic sensors is analyzed by artificial intelligence developed by Shell and rendered into 3D and 4D maps of oil reservoirs, with visualizations made immediately available to crews working at local factories, even though the analysis itself happens in the cloud. [Link to this question](#faq-who-helps-shell-visualize-its-oil-well-data) ### Does Shell share its big data with environmental organisations? Yes, Shell shares data with a few environmental organisations despite the two types of organizations being far apart in mission. Chief Technologist Gerald Schotman explained that during a brainstorm with environmental groups, they realized they could help migratory birds crossing the Sahara find water, and they also share data concerning whale migration patterns. [Link to this question](#faq-does-shell-share-its-big-data-with-environmental)