Page History

Table of Contents

Overview

Section

border	true

Column

Panel
Statistics for entire archiving period (2013-01-01 - present)

...

section

Column

Panel

border	true

Archive size [TBTiB]

SQL

border	0
noDataError	true
enableSorting	false
columnStyles	font-size: 1.0em
rowOrientation	horizontal
expandArray	false
style	fumble:0
convertNull	false
id	mydata3
dataSource	mars_apistats
enableHighlighting	false
table	false
retainRowStyleOrder	false

SELECT  to_char(Grand_total/1024^4, 'FM999,999,999,990.9999') FROM mars_dataset_details
WHERE name = 'tigge-lam' ORDER BY Date DESC LIMIT 1

Number of fields

SQL

border	0
noDataError	true
enableSorting	false
columnStyles	font-size: 1.0em
rowOrientation	horizontal
expandArray	false
style	fumble:0
convertNull	false
id	mydata3
dataSource	mars_apistats
enableHighlighting	false
table	false
retainRowStyleOrder	false

SELECT  to_char(Number_of_fields, 'FM999,999,999,990.999') FROM mars_dataset_details
WHERE name = 'tigge-lam' ORDER BY Date DESC LIMIT 1

1TB = 1024⁴ bytes

Column

Panel

Statistics for the period 2014-01-01 - present (earlier statistics not available)

Number of of active users

SQL

dataSource	mars_apistats
table	false

SELECT count(DISTINCT auth_user.username) as "Total number of users" FROM  auth_user
   RIGHT JOIN users_stats_monthly ON users_stats_monthly.username = auth_user.username
     WHERE users_stats_monthly.dataset='tigge-lam' and users_stats_monthly.month>=date'201301012013-01-01'
AND  auth_user.username IN (
      SELECT username                        
      FROM  users_stats_monthly
      WHERE dataset='tigge-lam'
      GROUP BY username
      HAVING sum(requests) >= 1)

Delivered data volume [TBGiB]

SQL

dataSource	mars_apistats
table	false

SELECT to_char(sum(delivered/1024^41024^3), 'FM999,999,999,990.9')FROM datasets_stats_monthly WHERE datasets_stats_monthly.dataset='tigge-lam' and datasets_stats_monthly.month>=date'201301012013-01-01';

Number of retrieved fields

SQL

border	0
noDataError	true
enableSorting	false
columnStyles	font-size: 1.0em
rowOrientation	horizontal
expandArray	false
style	fumble:0
convertNull	false
id	mydata3
dataSource	mars_apistats
enableHighlighting	false
table	false
retainRowStyleOrder	false

SELECT to_char(sum(fields),'FM999,999,999,999,999')
FROM  datasets_stats_monthly
WHERE datasets_stats_monthly.dataset='tigge-lam' and datasets_stats_monthly.month>=date'201301012013-01-01';

Number of user requests

SQL

border	0
noDataError	true
enableSorting	false
columnStyles	font-size: 1.0em
rowOrientation	horizontal
expandArray	false
style	fumble:0
convertNull	false
id	mydata3
dataSource	mars_apistats
enableHighlighting	false
table	false
retainRowStyleOrder	false

SELECT to_char(sum(requests), 'FM999,999,999,999,999')
FROM  datasets_stats_monthly
WHERE datasets_stats_monthly.dataset='tigge-lam' and datasets_stats_monthly.month>=date'201301012013-01-01';

Monthly sums

Data

...

volumes

...

Volume of data

retrieved from MARS before post-processing

...

vs volume of data delivered to users after post-processing.

Chart

showShapes	false
timePeriod	Quarter
width	1200
categoryLabelPosition	up45
dataOrientation	vertical
type	bar
yLabel	TBTiB
height	400

SQL

id	mydata
dataSource	mars_apistats

select  to_char(month, 'MM/YYYY') as monthyear, CAST(delivered AS FLOAT)/1024^4 as "delivered" from datasets_stats_monthly where dataset='tigge-lam' and month>=date'201301012013-01-01' order by month ;
select  to_char(month, 'MM/YYYY') as monthyear, CAST(retrieved AS FLOAT)/1024^4 as "retrieved" from datasets_stats_monthly where dataset='tigge-lam' and month>=date'201301012013-01-01' order by month

Users

...

Number of requests

Chart

showShapes	false
width	1200
categoryLabelPosition	up45
dataOrientation	vertical
type	bar
yLabel	Nr of requests
colors	#FFAB00
height	300

SQL

id	mydata
dataSource	mars_apistats

select  to_char(month, 'MM/YYYY') as monthyear, requests as "user requests" from datasets_stats_monthly where dataset='tigge-lam' and month>=date'201301012013-01-01' order by month;

Number of active users

Chart

showShapes	false
width	1200
categoryLabelPosition	up45
dataOrientation	vertical
type	bar
yLabel	Nr of users
colors	#36B37E
height	300

SQL

id	mydata
dataSource	mars_apistats

SELECT to_char(month, 'MM/YYYY') as monthyear, count(DISTINCT username) as "active users"
FROM  users_stats_monthly 
WHERE dataset='tigge-lam' AND month>=date'201301012013-01-01' 
AND username IN (
      SELECT username                        
      FROM  users_stats_monthly
      WHERE dataset='tigge-lam'
      GROUP BY username
      HAVING sum(requests) >= 1
      )
GROUP BY month
ORDER BY month;

...

as per 2018-06-01
only countries with at least 2 5 active users are shown

Chart

stacked	true
width	900
dataOrientation	vertical
opacity	75
height	700

SQL

id	mydata
dataSource	mars_apistats

SELECT profile_country.name, count(DISTINCT auth_user.username) as total_users
    FROM  profile_country
         RIGHT JOIN profile_profile ON profile_profile.country_id = profile_country.id
         RIGHT JOIN auth_user ON auth_user.id = profile_profile.user_id
         RIGHT JOIN users_stats_monthly ON users_stats_monthly.username = auth_user.username
    WHERE users_stats_monthly.dataset='tigge-lam' and users_stats_monthly.month>=date'201301012013-01-01'
GROUP BY profile_country.name
HAVING count(DISTINCT auth_user.username)>=21
ORDER BY total_users DESC

...

Space shortcuts

Page tree

Versions Compared

Old Version 12

New Version 13

Key

Overview

Monthly sums

Data

volumes

Users

Number of requests

Number of active users