Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Overview

background:#B8D1F3,background:#DAE5F4,background:#B8D1F3 @default testingretainRowStyleOrder
Section
bordertrue


Column


Panel

Statistics for the  entire archiving period since 2006-01-01

Archive size [PiB]


SQL
border0
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
dataSourcemars_apistats_new
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT  to_char(Grand_total/1024^5, 'FM999,999,999,999.000') FROM mars_dataset_details
WHERE name = 'tigge' ORDER BY Date DESC LIMIT 1


Number of  fields


SQL
border0
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
dataSourcemars_apistats_new
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT  to_char(Number_of_fields, 'FM999,999,999,990') FROM mars_dataset_details
WHERE name = 'tigge' ORDER BY Date DESC LIMIT 1


last updated

SQL
border1
rowStyles
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
class
dataSourcemars_apistats_new
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT date FROM mars_dataset_details
WHERE name = 'tigge' ORDER BY Date DESC LIMIT 1




Column


Panel

Statistics for the period since 2014-01-01

Number of active users


SQL
dataSourcemars_apistats_new
enableHighlightingfalse
tablefalse
SELECT count(DISTINCT auth_user.username) as "Total number of users" FROM  auth_user
   RIGHT JOIN users_stats_monthly ON users_stats_monthly.username = auth_user.username
     WHERE users_stats_monthly.dataset='tigge-global' and users_stats_monthly.month>=date'2006-01-01'
AND  auth_user.username IN (
      SELECT username                        
      FROM  users_stats_monthly
      WHERE dataset='tigge-global'
      GROUP BY username
      HAVING sum(requests) >= 1)


Delivered data volume [TiB]


SQL
dataSourcemars_apistats_new
table
false
SELECT to_char(sum(
fields
delivered/1024^4), 'FM999,999,999,
999,999
990.0')FROM datasets_stats_monthly 
as "Total retrieved fields",
WHERE datasets_stats_monthly.dataset='tigge-global' and datasets_stats_monthly.month>=date'2006-01-01';


Number of retrieved fields


SQL
border0
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
dataSourcemars_apistats_new
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT to_char(sum(
requests
fields),
'FM999,999,999,999,999')
as "Total user requests",

FROM  datasets_stats_monthly
WHERE datasets_stats_monthly.dataset='tigge-global' and datasets_stats_monthly.month>=date'2006-01-01';


Number of requests


SQL
border0
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
dataSourcemars_apistats_new
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT to_char(sum(
delivered/1024^4
requests), 'FM999
.
,999,999,999,999')
as "Delivered volume [TB]"

FROM  datasets_stats_monthly
WHERE datasets_stats_monthly.dataset='tigge-global' and datasets_stats_monthly.month>=date
'20061001';

Monthly sums

Delivered volume [TB]

'2006-01-01';


last updated

SQL
border0
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
dataSourcemars_apistats_new
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT to_char( datasets_stats_monthly.month, 'YYYY-MM-DD') FROM  datasets_stats_monthly WHERE datasets_stats_monthly.dataset='tigge-global' order by datasets_stats_monthly.month desc LIMIT 1;




Graphs


TB
Expand
titleMonthly sums
Chart
3Dtrue

(Monthly statistics are available only since  2015-01-01)

Data volumes

Volume of data retrieved from MARS before post-processing vs volume of data delivered to users after post-processing.

Chart
showShapesfalse
timePeriodQuarter
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabel
Chart
3Dtrue
TiB
height400


SQL
idmydata
dataSourcemars_apistats_new
select  to_char(month, 'MM/YYYY') as monthyear, 
CAST(delivered AS FLOAT)/1024^4 as "data volume
to_char(delivered/1024^4, 'FM999,999,999,990') as "delivered" from datasets_stats_monthly where dataset='tigge-global' and month>=date'2015-01-01' order by month ;
select  to_char(month, 'MM/YYYY') as monthyear, to_char(retrieved/1024^4, 'FM999,999,999,990') as "retrieved" from datasets_stats_monthly where dataset='tigge-global' and month>=date'
20061001
2015-01-01' order by month

User requests

(1 original user request could be split to more resulting  MARS database retrieval requests  shown in the graph below. It depends on MARS data design for given datasets. On average number of the original users requests is about 1/4 of the resulting "user requests" hitting MARS shown here)

400


Delivered data volume (zoom from the previous graph)

Chart
showShapesfalse
timePeriodQuarter
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelTiB
colors#008DA6, white
height300


SQL
idmydata
dataSourcemars_apistats_new
select  to_char(month, 'MM/YYYY') as monthyear, to_char(delivered/1024^4, 'FM999,999,999,990') as "delivered" from datasets_stats_monthly where dataset='tigge-global' and month>=date'2015-01-01' order by month ;


Number of requests

Chart
showShapesfalse
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelNr of requests
colors#FFAB00
height
300


SQL
idmydata
dataSourcemars_apistats_new
select  to_char(month, 'MM/YYYY') as monthyear, requests as "user requests" from datasets_stats_monthly where dataset='tigge-global' and month>=date'
20061001
2015-01-01' order by month;

Fields retrieved

(1 field means the retrieved field for given step, level, etc)


Number of active users

Chart
showShapesfalse
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelNr of users
colors#36B37E
height300


SQL
idmydata
dataSourcemars_apistats_new
SELECT to_char(month, 'MM/YYYY') as monthyear, count(DISTINCT username) as "active users"
FROM  users_stats_monthly 
WHERE dataset='tigge-global' AND month>=date'2015-01-01' 
AND username IN (
      SELECT username                        
      FROM  users_stats_monthly
      WHERE dataset='tigge-global'
      GROUP BY username
      HAVING sum(requests) >= 1
      )
GROUP BY month
ORDER BY month;




falseNr of fields
Expand
titleYearly sums

Data volumes

Volume of data retrieved from MARS before post-processing vs volume of data delivered to users after post-processing.

Chart
showShapesfalse
timePeriodQuarter
Chart
3Dtrue
showShapes
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabel
Chart
3Dtrue
TiB
height400


SQL
idmydata
dataSourcemars_apistats_new
select  to_char(month, 
'MM/
'YYYY') as year, to_char(sum(delivered/1024^4), 'FM999,999,999,990') as "delivered" from datasets_stats_monthly where dataset='tigge-global' and month>=date'2015-01-01'  group by year order by year ;
select  to_char(month, 'YYYY') as
monthyear, fields
 year, to_char(sum(retrieved/1024^4), 'FM999,999,999,990') as "retrieved" from datasets_stats_monthly where dataset='tigge-global' and month>=date'
20061001' order by month

Users

(Users at least with 3 requests ever since)

400
2015-01-01' group by year order by year


Delivered data volume (zoom from the previous graph)

Chart
showShapesfalse
timePeriodQuarter
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelTiB
colors#008DA6, white
height300


SQL
idmydata
dataSourcemars_apistats_new
select  to_char(month, 'YYYY') as year, to_char(sum(delivered/1024^4), 'FM999,999,999,990') as "delivered" from datasets_stats_monthly where dataset='tigge-global' and month>=date'2015-01-01'  group by year order by year ;


Number of requests

Chart
showShapesfalse
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelNr of requests
colors#FFAB00
height300


SQL
idmydata
dataSourcemars_apistats_new
select  to_char(month, 'YYYY') as year, sum(requests) as "user requests" from datasets_stats_monthly where dataset='tigge-global' and month>=date'2015-01-01'  group by year order by year ;


Number of active users

Chart
showShapesfalse
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelNr of users
colors#36B37E
height
300


SQL
idmydata
dataSourcemars_apistats_new
SELECT to_char(month, '
MM/
YYYY') as 
monthyear
year, count(DISTINCT username) as "active users"
FROM  users_stats_monthly 
WHERE dataset='tigge-global' AND month>=date'
20061001
2015-01-01' 
AND username IN (
      SELECT username                        
      FROM  users_stats_monthly
      WHERE dataset='tigge-global'
      GROUP BY username
      HAVING sum(requests) >= 
3
1
      )
GROUP BY 
month
year
ORDER BY 
month
year;



Users per

...

country

  • only countries with at least 5 active users are shown
Chart

(Users at least with 3 requests ever since)

Chart
3Dtrue
stackedtrue
width1200900
dataOrientationvertical
opacity75
height1200700


SQL
idmydata
dataSourcemars_apistats_new
SELECT profile_country.name, count(DISTINCT auth_user.username) as total_users
    FROM  profile_country
         RIGHT JOIN profile_profile ON profile_profile.country_id = profile_country.id
         RIGHT JOIN auth_user ON auth_user.id = profile_profile.user_id
         RIGHT JOIN users_stats_monthly ON users_stats_monthly.username = auth_user.username
    WHERE users_stats_monthly.dataset='tigge-global' and users_stats_monthly.month>=date'200610012006-01-01'
GROUP BY profile_country.name
HAVING count(DISTINCT auth_user.username)>=5
ORDER BY total_users DESC;

 




Section


Column

Image Added

At least one active user (as per  2018-06-01)


Column

Image Added

At least one active user with colour density depending on the number of active users (from 1 to 742)  (as per  2018-06-01)

...