Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Overview

background:#B8D1F3,background:#DAE5F4,background:#B8D1F3 class
Section
bordertrue


Column


Panel

Statistics for the entire archiving period since 2013-01-01

Archive size [TiB]


SQL
rowStyles
border1
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
@default testing
dataSourcemars_apistats_new
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT to_char(
sum(fields),
Grand_total/1024^4, 'FM999,999,999,999
,999
.000') FROM mars_dataset_details
WHERE 
as "Total retrieved fields",
name = 'tigge-lam' ORDER BY Date DESC LIMIT 1


Number of  fields


SQL
border1
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
dataSourcemars_apistats_new
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT to_char(
sum(requests)
Number_of_fields, 'FM999
,999
,999,999,999') FROM mars_dataset_details
WHERE name = 'tigge-lam' ORDER BY Date DESC LIMIT 1


Last updated on: 

SQL
border1
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
dataSourcemars_apistats_new
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT date FROM mars_dataset_details
WHERE name = 'tigge-lam' ORDER BY Date DESC LIMIT 1




Column


Panel

Statistics for the period since 2014-01-01

Number of active users


SQL
dataSourcemars_apistats_new
tablefalse
SELECT count(DISTINCT auth_user.username) as "Total number of users" FROM auth_user
 
requests",
RIGHT JOIN users_stats_monthly ON users_stats_monthly.username = auth_user.username
 WHERE users_stats_monthly.dataset='tigge-lam' and users_stats_monthly.month>=date'2013-01-01'
AND auth_user.username IN (
 SELECT username 
 FROM users_stats_monthly
 WHERE dataset='tigge-lam'
 GROUP BY username
 HAVING sum(requests) >= 3)


Delivered data volume [TiB]


SQL
dataSourcemars_apistats_new
tablefalse
SELECT to_char(sum(delivered/1024^4), 'FM999,999,999,990.999')
as "Delivered volume [TB]" FROM datasets_stats_monthly
FROM datasets_stats_monthly WHERE datasets_stats_monthly.dataset='tigge-lam' and datasets_stats_monthly.month>=date'2013-01-01';


Number of retrieved fields


SQL
border1
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
dataSourcemars_apistats_new
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT to_char(sum(fields),'FM999,999,999,999,999')
FROM datasets_stats_monthly
WHERE datasets_stats_monthly.dataset='tigge-lam' and datasets_stats_monthly.month>=date'2013-01-01';


Number of requests


SQL
border1
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
dataSourcemars_apistats_new
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT to_char(sum(requests), 'FM999,999,999,999,999')
FROM datasets_stats_monthly
WHERE datasets_stats_monthly.dataset='tigge-lam' and datasets_stats_monthly.month>=date'
20130101
2013-01-01';





Monthly sums

Delivered volume [TB]

Data volumes

Volume of data retrieved from MARS before post-processing vs volume of data delivered to users after post-processing.

true
Chart
Chart
3D
showShapesfalse
timePeriodQuarter
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelTBGiB
height400


SQL
idmydata
dataSourcemars_apistats_new
select  to_char(month, 'MM/YYYY') as monthyear, CASTto_char(delivered AS FLOAT)/1024^4/1024^3, 'FM999,999,999,990.999') as "data volumedelivered" from datasets_stats_monthly where dataset='s2stigge-lam' and month>=date'201505012013-01-01' order by month

User requests

(1 original user request could be split to more resulting  MARS database retrieval requests  shown in the graph below. It depends on MARS data design for given datasets. On average number of the original users requests is about 1/4 of the resulting requests shown here)

Chart
3Dtrue
showShapesfalse
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelNr of requests
height400
SQL
idmydata
dataSourcemars_apistats
select   ;
select to_char(month, 'MM/YYYY') as monthyear, requests, to_char(retrieved/1024^3, 'FM999,999,999,990.999') as "retrieved" from datasets_stats_monthly where dataset='s2stigge-lam' and month>=date'201505012013-01-01' order by month;

Fields retrieved

(1 field means the retrieved field for given step, level, etc)


Number of requests

(peak values not fully displayed:  03/2016: 2,770     09/2016 : 104,283     10/2016: 223,116)

true
Chart
Chart
3D
showShapesfalse
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelNr of fieldsrequests
colors#FFAB00
rangeAxisUpperBound1000
height400300


SQL
idmydata
dataSourcemars_apistats_new
select  to_char(month, 'MM/YYYY') as monthyear, fields requests as "user requests" from datasets_stats_monthly where dataset='s2stigge-lam' and month>=date'201505012013-01-01' order by month;

Users

(Users at least with 3 requests ever since)


Number of active users

true
Chart
Chart
3D
showShapesfalse
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelNr of users
colors#36B37E
height400300


SQL
idmydata
dataSourcemars_apistats_new
SELECT to_char(month, 'MM/YYYY') as monthyear, count(DISTINCT username) as "active users"
FROM  users_stats_monthly 
WHERE dataset='s2stigge-lam' AND month>=date'201505012013-01-01' 
AND username IN (
      SELECT username                        
      FROM  users_stats_monthly
      WHERE dataset='s2stigge-lam'
      GROUP BY username
      HAVING sum(requests) >= 31
      )
GROUP BY month
ORDER BY month;


Users per

...

country

  • as per  2018-06-01

Chart
3Dtrue
stackedtrue
width1200900
dataOrientationvertical
opacity75
height1200700


SQL
idmydata
dataSourcemars_apistats_new
SELECT profile_country.name, count(DISTINCT auth_user.username) as total_users
    FROM  profile_country
         RIGHT JOIN profile_profile ON profile_profile.country_id = profile_country.id
         RIGHT JOIN auth_user ON auth_user.id = profile_profile.user_id
         RIGHT JOIN users_stats_monthly ON users_stats_monthly.username = auth_user.username
    WHERE users_stats_monthly.dataset='s2stigge-lam' and users_stats_monthly.month>=date'201505012013-01-01'
GROUP BY profile_country.name
HAVING count(DISTINCT auth_user.username)>=1
ORDER BY total_users DESC;

 

...