Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Overview

Statistics for entire archiving period (2013-01-01 - present)

background:#B8D1F3,background:#DAE5F4,background:#B8D1F3
Section
bordertrue


Column


Panel


Archive size [TB]


SQL
border0
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
dataSourcemars_apistats
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT  to_char(Grand_total/1024^4, 'FM999,999,999,990.9') FROM mars_dataset_details
WHERE name = 'tigge-lam' ORDER BY Date DESC LIMIT 1


Number of  fields


SQL
border0
rowStyles
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
class@default testing
dataSourcemars_apistats
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT  to_char(
sum(fields),
Number_of_fields, 'FM999,999,999,
999,
990.999') FROM mars_dataset_details
WHERE name = 'tigge-lam' ORDER BY Date DESC LIMIT 1


1TB = 10244 bytes



Column


Panel


Number of  users


SQL
dataSourcemars_apistats
tablefalse
SELECT count(DISTINCT auth_user.username) as "Total 
retrieved
number of 
fields",
users" FROM  auth_user
   RIGHT JOIN users_stats_monthly ON users_stats_monthly.username = auth_user.username
     WHERE users_stats_monthly.dataset='tigge-lam' and users_stats_monthly.month>=date'20130101'
AND  auth_user.username IN (
      SELECT username                        
      FROM  users_stats_monthly
      WHERE dataset='tigge-lam'
      GROUP BY username
      HAVING sum(requests) >= 1)


Delivered data volume [TB]


SQL
dataSourcemars_apistats
tablefalse
SELECT to_char(sum(delivered/1024^4), 'FM999,999,999,990.9')FROM datasets_stats_monthly WHERE datasets_stats_monthly.dataset='tigge-lam' and datasets_stats_monthly.month>=date'20130101';


Number of retrieved fields


SQL
border0
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
dataSourcemars_apistats
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT to_char(sum(
requests
fields),
'FM999,999,999,999,999')
as "Total user requests",

FROM  datasets_stats_monthly
WHERE datasets_stats_monthly.dataset='tigge-lam' and datasets_stats_monthly.month>=date'20130101';


Number of user requests


SQL
border0
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
dataSourcemars_apistats
enableHighlightingfalse
tablefalse
retainRowStyleOrderfalse
SELECT to_char(sum(
delivered/1024^4
requests), 'FM999
.
,999,999,999,999')
as "Delivered volume [TB]"

FROM  datasets_stats_monthly
WHERE datasets_stats_monthly.dataset='tigge-lam' and datasets_stats_monthly.month>=date'20130101';





Monthly sums

Delivered volume [TB]

Data

  • delivered: data volume delivered to user after post-processing(e.g. interpolation)
  • retrieved: data volume retrieved from MARS before post-processing
    • retrieved data volume should be normally equal or bigger then the delivered one
    • it could be also smaller when user asks for higher then archived grid resolution (resulting in artificially bigger interpolated files - situation which should be rather avoided)
true
Chart
Chart
3D
showShapesfalse
timePeriodQuarter
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelTB
height400


SQL
idmydata
dataSourcemars_apistats
select  to_char(month, 'MM/YYYY') as monthyear, CAST(delivered AS FLOAT)/1024^4 as "data volumedelivered" from datasets_stats_monthly where dataset='tigge-lam' and month>=date'20130101' order by month

User requests

(1 original user request could be split to more resulting  MARS database retrieval requests  shown in the graph below. It depends on MARS data design for given datasets. On average number of the original users requests is about 1/4 of the resulting requests shown here)

Chart
3Dtrue
showShapesfalse
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelNr of requests
height400
SQL
idmydata
dataSourcemars_apistats
 ;
select  to_char(month, 'MM/YYYY') as monthyear, requests CAST(retrieved AS FLOAT)/1024^4 as "retrieved" from datasets_stats_monthly where dataset='tigge-lam' and month>=date'20130101' order by month;

Fields retrieved

(1 field means the retrieved field for given step, level, etc)


Users

  • user requests: number of MARS retrieval requests based on the original user request
  • active users: users with at least 1 request in given month
true
Chart
Chart
3D
showShapesfalse
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelNr of fieldsrequests
colors#FFAB00
height400300


SQL
idmydata
dataSourcemars_apistats
select  to_char(month, 'MM/YYYY') as monthyear, fields requests as "user requests" from datasets_stats_monthly where dataset='tigge-lam' and month>=date'20130101' order by month

Users

...

;



true
Chart
3D
showShapesfalserangeAxisTickUnit1
width1200
categoryLabelPositionup45
dataOrientationvertical
typebar
yLabelNr of users
colors#36B37E
height400300


SQL
idmydata
dataSourcemars_apistats
SELECT to_char(month, 'MM/YYYY') as monthyear, count(DISTINCT username) as "active users"
FROM  users_stats_monthly 
WHERE dataset='tigge-lam' AND month>=date'20130101' 
AND username IN (
      SELECT username                        
      FROM  users_stats_monthly
      WHERE dataset='tigge-lam'
      GROUP BY username
      HAVING sum(requests) >= 31
      )
GROUP BY month
ORDER BY month;


Users per

...

country

  • as per  2018-06-01
  • only countries with at least 2 active users are shown
Chart

(Users at least with 3 requests ever since)

false
Chart
3Dtrue
stackedtrue
width1200900
dataOrientationvertical
opacity75
height1200700


SQL
idmydata
dataSourcemars_apistats
SELECT profile_country.name, count(DISTINCT auth_user.username) as total_users
    FROM  profile_country
         RIGHT JOIN profile_profile ON profile_profile.country_id = profile_country.id
         RIGHT JOIN auth_user ON auth_user.id = profile_profile.user_id
         RIGHT JOIN users_stats_monthly ON users_stats_monthly.username = auth_user.username
    WHERE users_stats_monthly.dataset='tigge-lam' and users_stats_monthly.month>=date'20130101'
GROUP BY profile_country.name
HAVING count(DISTINCT auth_user.username)>=2
ORDER BY total_users DESC;
SQL
rowStylesbackground:#B8D1F3,background:#DAE5F4,background:#B8D1F3
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
class@default testing
dataSourcemars_apistats
enableHighlightingfalse
retainRowStyleOrder
SELECT * from profile_country limit 100


 

...

SQL
rowStylesbackground:#B8D1F3,background:#DAE5F4,background:#B8D1F3
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
class@default testing
dataSourcemars_apistats
enableHighlightingfalse
retainRowStyleOrderfalse
SELECT * from profile_profile limit 100

 

SQL
rowStylesbackground:#B8D1F3,background:#DAE5F4,background:#B8D1F3
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
class@default testing
dataSourcemars_apistats
enableHighlightingfalse
retainRowStyleOrderfalse
SELECT * from auth_user limit 100

...

rowStylesbackground:#B8D1F3,background:#DAE5F4,background:#B8D1F3
noDataErrortrue
enableSortingfalse
columnStylesfont-size: 1.0em
rowOrientationhorizontal
expandArrayfalse
stylefumble:0
convertNullfalse
idmydata3
class@default testing
dataSourcemars_apistats
enableHighlightingfalse
retainRowStyleOrderfalse

...