Comet Shoreline Pipeline MVP - Offcycle Summer 2023

The goal of these two offcycle sprints during the 2023 summer was to get the pipeline for ingesting into Comet and publishing to Shoreline working. We can successfully ingest to Comet and publish to Shoreline!

End of Workcycle

Spring 2023 End-of-Workcycle Update for Stakeholders

End of workcycle review for all products that were on sprint during the Winter 2022 workcycle. For each product, we will answer the following questions and give a high-level stakeholder-focused demo. 1. What was the goal of the workcycle? 2. What were the accomplishments of the workcycle? 3. Did we

Results of the 2023 Prioritization Exercise - The Lower Priorities

The following are the results of the prioritization exercise on January 18th, 2023. We drew a line about halfway down the list and determined that priorities that were above this line were the higher priorities and the ones below the line were lower priorities. That didn't mean that the lower

Comet

Comet Sprint 24 (May 3, 2023 – May 16, 2023)

What was the goal of Sprint 24? * To complete the work that we had scoped for the new permission structure (Visibility model) for Objects. There are now different levels to choose from, and these permissions are global (i.e they also impact other systems that this object will appear in)

Comet

Comet Sprint 23 (April 19, 2023 – May 2, 2023)

What was the goal of Sprint 23? To continue and complete the critical dependency update work for Comet (Hyrax Ruby 3.2) and to obtain alignment on the baseline stock “Visibility” model for Comet. There is more work to be done to get the Bulkrax Exporter to work, and there

Comet

Comet Sprint 22 (April 5, 2023 – April 18, 2023)

What was the goal of Sprint 22? In our last posting, we shared that we wanted to focus our efforts on the Ruby and Rails upgrades for all Surfliner products. The upgrades were completed for Lark, Shoreline, and Starlight, but Comet’s upgrade is still in progress. While there is

Comet

Comet Sprint 21 (March 15 - April 4, 2023)

What was the goal of Sprint 21? For the first two Surfliner Spring Workcycle sprints, we felt that it was important to work on technical debt and maintenance issues, most especially the Ruby and Rails upgrades for all Surfliner products. For the maintenance tasks, it should be noted that the

Results of the 2023 Prioritization Exercise - The Higher Priorities

The following are the results of the prioritization exercise on January 18th, 2023. We drew a line about halfway down the list and determined that priorities that were above this line were the higher priorities and the ones below the line were lower priorities. That didn't mean that the lower

Prioritization Exercise for 2023

This year, we formalized setting our priorities for the coming year through a "prioritization exercise." On Wednesday, January 18 from 9-11am, we completed a prioritization exercise called 20/20 Vision. An explanation of the exercise can be found at Gamestorming. Step 1 For each Surfliner product we asked the Tech

Comet

Comet Sprint 20 (December 2 - December 20, 2022)

What was the goal of Sprint 20? The goal of this Sprint was to continue work on batch ingest and export, and tying in ingest through Comet into the geospatial platform, Shoreline. Accomplishments of Sprint 20: * Updated the GBL1.0 to Aardvark JSON converter to meet Shoreline needs * Produced a

Comet

Comet Sprint 19 (November 16 - November 29, 2022)

What was the goal of Sprint 19? The goal for the overall work cycle is to shore up batch work for ingest and extend it to get batch round trip working so that you can do an export of batch metadata in some format, make changes in the exported format

Comet

Comet Sprint 18 (November 3 - November 15, 2022)

What was the goal of Sprint 18? The goal for this Sprint (for the overall work cycle) is to shore up batch work for ingest and extend it to get batch round trip working so that you can do an export of batch metadata in some format, make changes in

Summer 2022 End-of-Workcycle Update for Stakeholders (September 7, 2022)

End of workcycle review for all products that were on sprint during the Summer 2022 workcycle. For each product we will answer the following questions and give a high-level stakeholder-focused demo. 1. What was the goal of the workcycle? 2. What were the accomplishments of the workcycle? 3. Did we

Comet

Comet Sprint 17 (August 3 - August 16, 2022)

What was the goal of Sprint 17? * Pushing collections to the OAI endpoint (tidewater) and making the set harvestable from OAI * IIIF Image Server (Cantaloupe) wired into staging and production environments for each campus * Workflow-driven “publish” from Comet to the Shoreline geodata platform What is the milestone that this sprint

Comet

Comet: Sprint 16 (July 20, 2022 –August 2, 2022)

What was the goal of Sprint 16? * Editing and adding descriptive and other user defined metadata for existing objects * Running workflow and event triggered work (characterization, access derivatives) * Assigning permanent identifiers (primarily interested in the short term in ARKs as canonical IDs) * Publishing that content to a public access platform

Comet

Comet: Sprint 15 (July 6, 2022 - July 19, 2022)

What was the goal of Sprint 15? * Adding/editing descriptive and other user defined metadata * Running workflow and event triggered work (characterization) * Assigning permanent identifiers (ARKs) * Publishing to a public access platform (OAI, IIIF, Shoreline) What is the milestone that this sprint is supporting? To have a robust publish lifecycle

Comet

Comet: Sprint 14 (June 22, 2022 - July 6, 2022)

What was the goal of Sprint 14? * Uploading content singularly and in batch * Editing and adding descriptive and other user defined metadata for existing objects * Running workflow and event triggered work (characterization, access derivatives) * Assigning permanent identifiers (primarily interested in the short term in ARKs as canonical IDs) * Publishing that

Starlight

Starlight: Sprint 13 (April 13- 26, 2022)

What was the goal of Sprint 13? The Surfliner team has been experimenting with regular dedicated off-cycle sprints to focus on maintenance, upgrades, and new features for in-production products such as Starlight (in production since 2019). The goals of Sprint 13 were a combination of all of these things. A

End of Workcycle

Winter 2022 End-of-Workcycle Update for Stakeholders

End of workcycle review for all products that were on sprint during the Winter 2022 workcycle. For each product we will answer the following questions and give a high-level stakeholder-focused demo. 1. What was the goal of the workcycle? 2. What were the accomplishments of the workcycle? 3. Did we

Shoreline

Shoreline: Sprint 24 (March 2-15, 2022)

(This session was not recorded) What was the goal of Sprint 24? For Sprint 24, the following goals were set: * Determine the formatting of the URL in the CSV to support downloads of original datasets * Continue getting UCLA up to speed on Surfliner devops work * Update Geoserver to 2.19.

Shoreline

Shoreline: Sprint 23 (Feb. 16-Mar. 1, 2022)

(This session was not recorded) What was the goal of Sprint 23? For Sprint 23, the following goals were set: * Research the mechanism for supporting downloads of original datasets * Research the mechanism for supporting the ingest of GeoTIFFs * Provide support for external/standalone Solr instances * Get UCLA up to speed

Comet

Comet: Sprint 13 (March 2, 2022 – March 15, 2022)

Note: This session was not recorded What was the goal of Sprint 13? * Documentation of work done already in the work cycle. Leave things in as clean a state as possible before we break for several months * Set up meetings to address key questions and concerns before we break * Complete

Comet

Comet: Sprint 12 (February 16, 2022 – February 28, 2022)

What was the goal of Sprint 12? Continuation of work for Comet API and MQ What is the milestone that this sprint is supporting? Deployment of Tidewater in staging and production environments and showing that data can be consumed with a consumer script Accomplishments of Sprint 12: Comet: * Can generate

Comet

Comet: Sprint 11 (February 2, 2022 – February 15, 2022)

Note: This session was not recorded What was the goal of Sprint 11? Comet API and MQ What is the milestone that this sprint is supporting? Implementing Comet’s metadata API and integrating with a message broker (RabbitMQ). Accomplishments of Sprint 11: * Schema loader support that is not dependent on

Comet

Comet: Sprint 10 (January 19, 2022 – February 1, 2022)

What was the goal of Sprint 10? * Discovery via OAI-PMH (Comet → OAI). What is the milestone that this sprint is supporting? Laying the groundwork for discovery for the publishing of Comet objects into any number of discovery platforms using the OAI-PMH protocol. Accomplishments of Sprint 10: * Set up an initial