Public Datafiles And Dependencies

About This Script

Whimsy tools consume and produce a variety of data files about PMCs and the ASF as a whole. This non-comprehensive page explains which tools generate what intermediate data, and where the canonical underlying data sources are (many of which are privately stored). .json files generated in /public are consumed by many other websites.

Whimsy has a number of cron jobs - typically hourly - that periodically regenerate the /public directory, but only when the underlying data source has changed. See the server setup docs for more info. You can see the code for this script , the underlying data file , the key to this data , and many of the public JSON data files.

REMINDER: These datafiles are not original sources of truth, and merely make data from other canonical systems available in a more easily digested format on a periodic basis. Data here may be outdated depending on when updates were last made. See notifications@whimsical for updates

Related Whimsy Links

dataflow.json List of other public JSON and other data sources and underlying code models.
Maintained by role/PMC: whimsy
committee-info.json Committee (PMC) names and membership
Maintained by Whimsy PMC using script: /www/roster/public_committee_info.rb
Data structure: hash of hashes['committees']['accumulo']['display_name'] = 'Accumulo'
Derived from:
- /lib/whimsy/asf/committee.rb
- /lib/whimsy/asf/person.rb
- private/committers/board/committee-info.txt
committee-retired.json Summary details of retired committees
Maintained by Whimsy PMC using script: /www/roster/public_committee_info.rb
Data structure: hash of hashes['retired']['abdera']['display_name'|'retired'|'description']
Derived from:
- /lib/whimsy/asf/committee.rb
- private/committers/board/committee-info.yaml
icla-info.json Names of people who have submitted ICLAs who have uids (committer accounts)
Maintained by Whimsy PMC using script: /www/roster/public_icla_info.rb
Data structure: hash of hash['committers']['curcuru'] = 'Shane Curcuru'
Derived from:
- /lib/whimsy/asf/icla.rb
icla-info_noid.json Names of people who have submitted ICLAs who don't (yet) have uids (committer accounts)
Maintained by Whimsy PMC using script: /www/roster/public_icla_info.rb
Data structure: hash of array['non_committers'][0] = 'NonCommitter Name'
Derived from:
- /lib/whimsy/asf/icla.rb
member-info.json ASF Member id listing
Maintained by Whimsy PMC using script: /www/roster/public_member_info.rb
Data structure: hash of arrays['members'][0] = 'aadamchik' and hash['ex_members']['dion'] = 'Deceased Member (RIP)'
Derived from:
- /lib/whimsy/asf/member.rb
pods-scan.json Current status of Incubator podling websites relating to required navigation links
Maintained by Whimsy PMC using script: /tools/site-scan.rb
Data structure: hash of hashes['airflow']['display_name'] = 'Airflow'
Derived from:
- https://www.apache.org/foundation/marks/pmcs
public_ldap_authgroups.json Membership of LDAP auth groups. Membership of an LDAP auth group is used to grant commit karma for sub-project and other resources
Maintained by Whimsy PMC using script: /www/roster/public_ldap_authgroups.rb
Data structure: hash of hashes['auth']['apachecon']['roster'][11] = 'rbowen'
Derived from:
- /lib/whimsy/asf/ldap.rb
public_ldap_groups.json Membership of the remaining LDAP unix groups (apsite, committers and member).
Maintained by Whimsy PMC using script: /www/roster/public_ldap_groups.rb
Data structure: hash of hashes['groups']['committers']['roster'][0] = 'tba'
Derived from:
- /lib/whimsy/asf/ldap.rb
public_ldap_people.json Basic details of LDAP personal entries. Shows the public name and whether the login is currently disabled
Maintained by Whimsy PMC using script: /www/roster/public_ldap_people.rb
Data structure: hash of hashes['people']['curcuru']['name'] = 'Shane Curcuru'
Derived from:
- /lib/whimsy/asf/ldap.rb
public_ldap_projects.json Details of PMCs and Podlings. The 'owners' list holds the ids with (P)PMC karma, and the 'members' list holds the ids with (P)PMC committer karma.
Maintained by Whimsy PMC using script: /www/roster/public_ldap_projects.rb
Data structure: hash of hashes['projects']...
Derived from:
- /lib/whimsy/asf/ldap.rb
public_ldap_roles.json Membership of LDAP role groups. For example committers shows the list of people with committer karma
Maintained by Whimsy PMC using script: /www/roster/public_ldap_roles.rb
Data structure: hash of hashes['rolegroups']['committers']['roster'][n] = 'brett'
Derived from:
- /lib/whimsy/asf/ldap.rb
public_ldap_services.json Membership of LDAP service groups. For example pmc_chairs shows the list of people with PMC chair karma
Maintained by Whimsy PMC using script: /www/roster/public_ldap_services.rb
Data structure: hash of hashes['services']['board']['roster'][1] = 'brett'
Derived from:
- /lib/whimsy/asf/ldap.rb
public_nonldap_groups.json Membership of auth groups not defined in LDAP. (this file is likely to become obsolete)
Maintained by Whimsy PMC using script: /www/roster/public_nonldap_groups.rb
Data structure: hash of hashes['groups']['blur']['roster'][0] = 'dblevins'
Derived from:
- /lib/whimsy/asf/ldap.rb
public_podling_status.json Current Incubation status of each podling
Maintained by Whimsy PMC using script: /www/roster/public_podlings.rb
Data structure: hash of hashes['podling']['abdera'] = 'graduated'
Derived from:
- /lib/whimsy/asf/podlings.rb
public_podlings.json Listings of podling data TODO?
Maintained by Whimsy PMC using script: /www/roster/public_podlings.rb
Data structure: hash of hashes['podling']['abdera']['name'] = 'Abdera'
Derived from:
- /lib/whimsy/asf/podlings.rb
site-scan.json Current status of project websites relating to required navigation links
Maintained by Whimsy PMC using script: /tools/site-scan.rb
Data structure: hash of hashes['accumulo']['display_name'] = 'Accumulo'
Derived from:
- https://www.apache.org/foundation/marks/pmcs
pmcs Policy for display of Apache PMC websites
Maintained by role/PMC: vp-brand
/lib/whimsy/asf/auth.rb ASF::Authorization: Models LDAP and other authorizations based on id.apache.org; See also ASF::Person
Maintained by role/PMC: vp-whimsy
Derived from:
- infrastructure-puppet/modules/subversion_server/files/authorization/
/lib/whimsy/asf/committee.rb ASF::Committee: model both PMCs and other committees; See also ASF::Person
Maintained by role/PMC: vp-whimsy
Derived from:
- private/committers/board/committee-info.txt
/lib/whimsy/asf/icla.rb ASF::ICLA: Tracks ICLAs and names; See also ASF::Person
Maintained by role/PMC: vp-whimsy
Derived from:
- private/foundation/officers/iclas.txt
- *reserved-ids.yml
- *historic/committers.json
/lib/whimsy/asf/ldap.rb ASF::LDAP: See also ASF::Config, Person, Member, Group
Maintained by role/PMC: vp-whimsy
Derived from:
- ASF::LDAP::HOSTS
- apache/infrastructure-puppet/deployment/data/common.yaml
/lib/whimsy/asf/mail.rb ASF::Mail: Associate email addresses with Persons; See also ASF::Config, Person, Committee, Podling
Maintained by role/PMC: vp-whimsy
Derived from:
/lib/whimsy/asf/member.rb ASF::Member: Data and auth about ASF Members; See also ASF::Person
Maintained by role/PMC: vp-whimsy
Derived from:
- private/foundation/members.txt
/lib/whimsy/asf/nominees.rb Extends ASF::Person to add data about nominees around meetings
Maintained by role/PMC: vp-whimsy
Derived from:
- special/nominated-members.txt
/lib/whimsy/asf/person.rb ASF::Person: Data about an ICLA signer, committer, etc.; Extensive integration with ASF::LDAP for auth
Maintained by role/PMC: vp-whimsy
Derived from:
- /lib/whimsy/asf/ldap.rb
- /lib/whimsy/asf/icla.rb
/lib/whimsy/asf/podlings.rb ASF::Podlings: Committee analogue for Incubator podlings
Maintained by role/PMC: vp-whimsy
Derived from:
- asf/incubator/public/trunk/content/podlings.xml
/lib/whimsy/asf/rack.rb ASF::Rack: add functionality to ASF::Auth, ASF::Committers, ASF::MembersAndOfficers
Maintained by role/PMC: vp-whimsy
/lib/whimsy/asf/svn.rb ASF::SVN: Utility for SVN repo and file access; See also ASF::Config(reads .whimsy)
Maintained by role/PMC: vp-whimsy
/lib/whimsy/asf/git.rb ASF::Git: Utility for Git repo and file access; See also ASF::Config(reads .whimsy)
Maintained by role/PMC: vp-whimsy
/lib/whimsy/asf/agenda.rb ASF::Board::Agenda: Utility for approved and posted board minutes; many touchpoints: roster tool, board minutes
Maintained by role/PMC: vp-whimsy
Derived from:
- https://www.apache.org/foundation/board/
private/committers/board/committee-info.txt Official record of PMC and committee membership
Maintained by role/PMC: secretary
infrastructure-puppet/modules/subversion_server/files/authorization/ Authorization records for source control repos
Maintained by role/PMC: infra-staff
private/foundation/officers/iclas.txt Official record of signed ICLAs
Maintained by role/PMC: secretary
*reserved-ids.yml ID names reserved from use by committers
Maintained by role/PMC: infra-staff
*historic/committers.json Historical data about past committer date changes
Maintained by role/PMC: vp-whimsy
apache/infrastructure-puppet/deployment/data/common.yaml Core infrastructure data locations
Maintained by role/PMC: infra-staff
private/foundation/members.txt Official record of ASF corporate Membership
Maintained by role/PMC: secretary
special/nominated-members.txt Temporary listing of Member nominees before a Member's Meeting
Maintained by role/PMC: secretary
asf/incubator/public/trunk/content/podlings.xml Listing of active podlings and incubation status details
Maintained by role/PMC: vp-incubator
asf/infrastructure/site/trunk/content/index.html Listing of active podling websites
Maintained by role/PMC: vp-incubator
board Official records and calendar of ASF Board of Directors
Maintained by role/PMC: secretary

The /x1/srv/whimsy/www/test/dataflow.json file is currently a manually maintained file where the hash key identifies a file:

Starting with 'http' means it's at a public URL
Starting with '/' means it's a path within whimsy repo
All other paths means it's an SVN/Git reference from repository.yml

Maintainers starting with '/' are a path to a script
All other maintainers are a role or PMC