Software and Cyberinfrastructure
List of all ICICLE Components available Here
Accordions
Release Notes
New to ICICLE CI Catalog
Intelligent Cyberinfrastructure
AI Foundations
-
Iluvatar Functions as a Service (FaaS) Control Plane v1.0.0
- Iluvatar is an open Serverless platform built with the goal of jumpstarting and streamlining FaaS research. It provides a system that is easy and consistent to use, highly modifiable, and directly reports experimental results.
ICICLE CI Components Changelog
Intelligent Cyberinfrastructure
Software Architecture and Design
- Tapis Federated Authentication Service v1.5.0
- New features:
- Tenants are now able to determine how long the MFA authentication should last before the user has to re-enter their MFA
- Updated HTML - all of the different pages of the authentication workflow now have updated design layouts
- Bug Fixes
- The device code flow, starting with GET /v3/device?client_id=<client_id>, is now working for all login methods
- The language for the user code form of the device flow is now more clear
- New features:
- Tapis Pods Service v1.5.3
- Breaking Changes:
- Implemented direct access to NFS server instead of routing through Files for volumes/snapshots.
- This solves occassional networking hiccups causing troubles when Files couldn’t be accessed.
- This solves deployment across multiple namespaces as Files access was a stickler.
- Health is now split into health and health-central.
- health-central deploys with the main stack.
- It takes care of metrics, traefik management, and NFS management.
- health deploys with computer (health and spawner) in whatever namespace.
- Takes care of Kubernetes health and management in a particular namespace.
- health-central deploys with the main stack.
- New deployment files for the above features along with deleting no longer used files.
- Works locally as well.
- Fix in traefik to properly throw a 500 so proxy backup in nginx works properly when no location is matched.
- Implemented direct access to NFS server instead of routing through Files for volumes/snapshots.
- New Features
- Added health deployment that doesn’t restart, allowing for easier debugging.
- Improvements to NFS permissions
- Bug fixes:
- Improvements for health regarding processes when new tenants are created while already running.
- Breaking Changes:
Release Notes
New to ICICLE CI Catalog
Intelligent Cyberinfrastructure
AI for CI-for-AI
- High Performance Computing Applications Dataset v1.0
- The High Performance Computing Applications Dataset is a collection of information about loops in high-performance computing programs. The dataset includes details about different aspects of loops, like how many times they repeat and how they access data. It also provides advanced information about how the computer hardware behaves during the program's execution. This dataset is meant to help researchers and engineers improve their programs by understanding and optimizing these loops better.
Software Architecture and Design
- iciflaskn v1.0
- The iciflaskn package provides a Flask blueprint that can be registered with your Flask application to endow it with Tapis Federated Authentication Service based on OAuth2. Please visit the Tapis documentaiton and Tapis APIs to learn how to setup an authentication client for your application.
ICICLE CI Components Changelog
Intelligent Cyberinfrastructure
AI for CI-for-AI
- HPC Application Runtime Predictor (HARP) v2.0
- New Features
- HARP is now Containerized! Profile your applications by configuring them with the new HARP containers.
- Available for use on both TACC and OSC systems via Tapis.
- New Jupyter Notebooks available on Google Colab and for download in GitHub repository.
- New Features
Software Architecture and Design
-
- Changes:
- Added better positional support
- Fixed command parsing and validation server side
- Improved login UX with suggestions for auth type and tenant uri
- Improved help menus
- Added jobs commands
- Fixed data formatters to be more flexible
- Much improved UX for deeply nested forms for operations like system creation.
- Add support for loading existing data when updating services
- Fixed a minor issue with the 'exit' command
- Improved support for jobs
- Bug fixes for postgres pods
- Fixed issues involving credential retrieval for pods
- Made snapshot commands their own thing
- Added authenticator clients command group
- Changes:
-
- Changes:
- Added support for Knowledge Graph queries that return edges
- Added automation for creation and deletion within Knowledge Graphs, past read-only operations.
- Integrated Tapis federated authentication
- Integration with GPT-3.5 via OpenAI API for natural language queries
- Changes:
Use Inspired Science
Animal Ecology
- Camera-Traps Edge Simulator v0.3.2
- Changes:
- Runtime configuration updates, principally involving changes to the releases directory structure.
- Improved release procedure documentation in top-level README file.
- Changes:
Visual Analytics
- Smart Foodsheds Visual Analytics (VA) Dashboard v0.3
- New Features:
- OAuth2 Authentication added via Tapis Federated Authentication: Log in with your TACC or globus (University, National Lab, Google, etc) accounts.
- Changes
- Improved save/load functionalities; Saved data is now tied to your authenticated account.
- New Features:
Release Notes
New to ICICLE CI Catalog
Intelligent Cyberinfrastructure
AI Foundations
-
- A Conversational AI model, which users can interact with it regarding food insecurity queries. The model responds with a list of commands in which an agent-based model can be run to simulate food insecurity levels in a given region.
To query the model go to https://foodshedconvai.pods.icicle.tapis.io/query?q=<your query>, where you replace <your query> with your query.
- A Conversational AI model, which users can interact with it regarding food insecurity queries. The model responds with a list of commands in which an agent-based model can be run to simulate food insecurity levels in a given region.
-
Species Classification using Multimodal Heterogeneous Context v0.1.0
- A species classification model that utilizes heterogeneous image contexts organized in a multimodal knowledge graph. The multimodal knowledge graph may include diverse forms of heterogeneous contexts that pertain to different modalities, such as numerical information for locations and time, categorical data for species/taxon IDs, and visual content such as images.
-
- Region2vec is a Community Detection algorithm on Spatial Networks that uses graph embeddings with node attributes and spatial interactions. Region2vec first generates node embeddings for regions that share common attributes and have intense spatial interactions, and then applies clustering algorithms to detect communities based on their embedding similarity and geographic adjacency.
Software Architecture and Design
-
Tapis Federated Authentication Service v1.3.4
- The Tapis Federated Authentication Service provides OAuth2-based authentication module that allows third-party applications to authenticate users from different identity providers. Including university credentials, HPC center accounts (e.g., TACC accounts), and web and social login (e.g., GitHub, Google, etc).
To view the APIs please visit https://tapis-project.github.io/live-docs/?service=Authenticator#tag/Cl…
- The Tapis Federated Authentication Service provides OAuth2-based authentication module that allows third-party applications to authenticate users from different identity providers. Including university credentials, HPC center accounts (e.g., TACC accounts), and web and social login (e.g., GitHub, Google, etc).
-
- First a part of Hello ICICLE Authentication Clients v0.0.1, ICICONSOLE is now a PyPI package. The command line interface (CLI) tool to authenticate with the Tapis Pods service. The tool allows the user to manage, operate, and interactively explore Tapis services.
-
- The ICICLE CLI tool to interact with Tapis is officially its own component coming from Hello ICICLE Authentication Clients v0.0.1. TapisCL-ICICLE now utilizes the Tapis Federated Authentication Service.
Use Inspired Science
Digital Agriculture
-
ICICLE Digital Agriculture Hub v1.0
- The Digital Agriculture Hub is the source for end users to access data-driven, edge services such as aerial scouting and sprayer control, and to initiate cloud jobs for agricultural workloads.
Please log in with your google account to begin using the microservices.
- The Digital Agriculture Hub is the source for end users to access data-driven, edge services such as aerial scouting and sprayer control, and to initiate cloud jobs for agricultural workloads.
-
- This tool is used to simulate power demands, cpu usage and other far-edge metrics for aerial missions. You can use Far-Edge Edge Simulator by visiting the Digital Agriculture Hub and selecting the "Far-Edge Edge Simulator" tab.
Please log in with your google account to begin using the microservices.
- This tool is used to simulate power demands, cpu usage and other far-edge metrics for aerial missions. You can use Far-Edge Edge Simulator by visiting the Digital Agriculture Hub and selecting the "Far-Edge Edge Simulator" tab.
-
In-Field Helper for Crop Scouts v1.0
- Given (1) a set of agricultural images labeled by a neural network and (2) a set of images on a new field, this tool explains to scouts if the images of the new field fully vet the neural network. Go to the Digital Agriculture Hub and select the "In-Field Helper for Crop Scouts" tab to use this tool.
Please log in with your google account to begin using the microservices.
- Given (1) a set of agricultural images labeled by a neural network and (2) a set of images on a new field, this tool explains to scouts if the images of the new field fully vet the neural network. Go to the Digital Agriculture Hub and select the "In-Field Helper for Crop Scouts" tab to use this tool.
Smart Foodsheds
-
Persons-Projects-Organizations-Datasets_California (PPOD_CA) Knowledge Graph v23.06
- PPOD_CA is a knowledge graph of PPOD information describing connections between environmental conservation and the food system in California.
-
- This prototype web application provides users with an engaging and interactive platform to explore an agent-based model. The model allows for dynamic simulations and captures the complex interactions between different types of households and markets. By utilizing this model, users can gain valuable insights into the food insecurity levels experienced by various types of households.
For more inforamtion please visit https://github.com/ICICLE-ai/Store_Closure_Website
- This prototype web application provides users with an engaging and interactive platform to explore an agent-based model. The model allows for dynamic simulations and captures the complex interactions between different types of households and markets. By utilizing this model, users can gain valuable insights into the food insecurity levels experienced by various types of households.
ICICLE CI Components Changelog
Intelligent Cyberinfrastructure
Software Architecture and Design
- Tapis Pods Service v1.3.2
- New features:
- Added volume and snapshot support/utils/models/etc. Using nfs pvc storage to volume mount block storage to running pods. Users can share volumes and collaborate live on the same storage. Snapshots allow users to take copies of volumes for data versioning purposes.
- Traefik proxying now automatically creates certificates at runtime for each subdomain (meaning each pod).
- Service no longer requires initial, or any, manual certificate creation.
- Some edits for Neo4j as it requires a injected cert.
- Changes for local dev as it's now different from deployment.
-
For more inforamtion please visit https://github.com/ICICLE-ai/Store_Closure_Website
- New features:
- TapisCL-ICICLE v0.1.4
- Changes:
- Added Tapis federated authentication, and device code authentication grant types to allow for more flexible access to Tapis resources. Full revamp of the whole authentication workflow.
- Overhaul of user interface and command entry to provide better interactivity with commands that previously required config files to execute properly
- More effective command line argument validation to sanitize data input
- Overhaul of files and systems to grant user access to additional Tapis resources (WIP). Files and systems strive to emulate linux bash command line, using commands like cd and ls.
- Support for Tapis postits added
- Planned Changes:
- Finish upgrading system authentication to fully complete system access
- Upgrade app commands and eventually implement intuitive job submission
- Refactor help generation code
- Changes:
- ICICONSOLE v0.0.10
- Changes:
- Improved user interface for select queries. Now, the user can select a query from a list of available queries (help command), and the query will be executed automatically. This works toward an automated process for querying Knowledge Graphs.
- For Knowledge Graph queries that return entire node(s), a separate view will be opened to display the node in a more readable format. In this view, scrolling is enabled to see the complete data in the confined space of the terminal.
- Minor bug fixes
- Planned Changes:
- Add support for Knowledge Graph queries that return edges
- Add automation for creation and deletion within Knowledge Graphs, past read-only operations.
- Integrate Tapis federated authentication
- Create a natural language interface for querying Knowledge Graphs, which would automate the automation process itself. This would be a long-term goal, and would require a lot of research and development.
- Changes:
Use Inspired Science
Animal Ecology
- Camera-Traps Edge Simulator v0.3.1
- Changes:
- Support for 2 new power monitoring events
- Removal of image_uuid field from ImageLabelScore type used in ImageScoredEvent.
- MonitorPowerStartEvent and MonitorPowerStopEvent implemented in Rust (Python support in progress).
- The image_store_plugin deletes files of all types associated with an image when that image is deleted.
- Changes:
Visual Analytics
- Smart Foodsheds Visual Analytics (VA) Dashboard v0.2
- New Features:
- Added save/load functionalities, allowing users to bring their own data and share data in the future.
- Changes:
- Default graph animation is set to static, providing better placement of the graph within the panel.
- Implemented automatic coloring scheme to differentiate between different node types.
- Replaced the reset graph function with an undo function, providing a more intuitive experience for users.
- Fixed various minor UI issues.
- New Features:
Release Notes
-
Intelligent Cyberinfrastructure
-
AI for CI-for-AI
- HPC Application Runtime Predictor (HARP) <1.0> - The HARP framework is used to generate a history of executions with the help of human-inloop (pre-defined configurations) and train suitable regression models to estimate the approximate execution time for a targeted application.
- Intelligent Sparse Library (iSpLib) <1.0> - iSipLib is an accelerated sparse kernel library with a PyTorch interface. It aims to provide efficient sparse operations for Graph Neural Network implementations.
-
Software Architecture and Design
- Base ICICLE Tapis Software <1.3.0> - Tapis is a hosted, web-based API framework for securely managing computational workloads across infrastructure and institutions so that experts can focus on their research instead of the technology.
- Event Engine <0.2.0> - The Event Engine is a framework for edge simulators and for writing event-based applications in Rust. The Event Engine utilizes a plugin architecture so that they can be written in multiple languages.
-
Hello ICICLE Authentication Clients <0.0.1> - Hello ICICLE Authentication consists of two command line interface (CLI) tools to authenticate with the Tapis Pods service. The first tool, ICICONSOLE, is specifically tailored to working with Neo4j databases hosted through the Tapis Pods. The second tool, TapisCL-ICICLE, allows the user to manage, operate, and interactively explore Tapis services.
-
Tapis Pods Service <1.3.0> - The Tapis Pods Service provides a web service and distributed platform providing Pods-as-aService platform via Kubernetes. The primary use of this service is to provide quick to deploy long-lived services based on Docker images that are exposed via HTTP or TCP endpoints.
-
CI Components Catalog <0.1.0> - Hosted using our Tapis Pods Service, the CI Components Catalog showcases the most up-to-date released CI components available to the public.
-
-
Use Inspired Science
-
Animal Ecology
- Camera-Traps Edge Simulator <0.3.0> - Both a simulator and an edge device application for classifying images with the first deployment specializing in wildlife images. The Camera-Traps Edge Simulator utilizes the Event Engine to implement its plugin architecture and event-driven communication.
-
Digital Agriculture
- SoftwarePilot <1.2.5> - SoftwarePilot is an open source middleware and API that supports aerial applications. It allows users to connect consumer Parrot Anafi drones and access the drone's flight controller, camera, and navigation system via Python scripts. SoftwarePilot can also communicate with applications via a REST API and built-in Docker integration.
-
Smart Foodsheds
- Persons-Projects-Organizations-Datasets (PPOD) Schema <0.9.1> - A LinkML schema for a version of the PPOD (Persons-Projects-Organizations-Datasets) data pattern that describes resources being cataloged by the UC Davis Food Systems Lab. These resources are pertinent to California foodsheds and conservation activities and include lists of organizations, people, programs, projects, tools, datasets, guidelines, and mandates.
- Smart Foodsheds Visual Analytics (VA) Dashboard <0.1> - Hosted using our Tapis Pods Service, the Smart Foodsheds VA Dashboard is a visual analytics system built for smart foodsheds that offers a dynamic and engaging way to explore graph data. The dashboard currently has access to PPOD and Cold Chain datasets. For more information on usage.
-