Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docs(meeting notes) update documentation of week-07 meeting. #250

Merged
merged 2 commits into from
Jul 9, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
59 changes: 59 additions & 0 deletions docs/2024/scheduler/updates/Discussion/2024-06-21.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,59 @@
---
title: week-07
author: Aaditya Singh
---
<!--
SPDX-License-Identifier: CC-BY-SA-4.0

SPDX-FileCopyrightText: 2024 Aditya Singh <singh.aaditya889@gmail.com>
-->
---

# Meeting 14
*(June 21,2024)*

## Participants

### Mentors

- [Katharina Ettinger](https://github.com/EttingerK)
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd)
- [Kaushlendra Pratap](https://github.com/Kaushl2208)
- [Gaurav Mishra](https://github.com/GMishx)

### Contributors

- [Aaditya Singh](https://github.com/Aaditya-Singh78)

## Discussion:

**Contributor:**

- [Aaditya Singh](https://github.com/Aaditya-Singh78): Presented a thorough analysis of a use case, identifying several important aspects:
1. Clear separation of dependent and independent job queues.
2. Implementation of a rate limiter using a sliding window log.
3. Application of semaphores for queue synchronization.
4. Integration of feedback through *[Telegraf](https://www.influxdata.com/time-series-platform/telegraf/)*.

![golang_architecture](../../asset/golang_arch.png)

> ⚠️ In the diagram above, mutexes and channels for synchronization haven't been considered yet. Introducing single semaphore into the diagram might undermine the goal of achieving parallelism in extreme situations.


- [Aaditya Singh](https://github.com/Aaditya-Singh78): Concluded that the architecture faces several challenges:
1. Potential deadlocks from using multiple semaphores.
2. Limitations of using a single semaphore under certain conditions affecting multiprogramming.
3. The need for a load balancer to prioritize users based on their analysis needs or project size.
4. Establishment of a heartbeat mechanism to monitor system performance.

**Mentors**:

- [Kaushlendra Pratap](https://github.com/Kaushl2208): Discussed the potential deadlock issues with the use of multiple semaphores.

- [Gaurav Mishra](https://github.com/GMishx): Suggested the implementation of a heartbeat system, possibly through Grafana, to oversee system health.

- [Katharina Ettinger](https://github.com/EttingerK): Asked about the scalability of the current approach given the project size and complexity.

- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd): Proposed integrating a priority mechanism within the dependent queue to optimize processing time for smaller or less complex projects.

>ℹ️: Additional studies and enhancements are considered for these areas.
4 changes: 4 additions & 0 deletions docs/2024/scheduler/updates/Discussion/_category_.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
{
"label": "Discussion",
"position": 4
}
71 changes: 71 additions & 0 deletions docs/2024/scheduler/updates/General/2024-06-20.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,71 @@
---
title: week-07
author: Aaditya Singh
---
<!--
SPDX-License-Identifier: CC-BY-SA-4.0

SPDX-FileCopyrightText: 2024 Aditya Singh <singh.aaditya889@gmail.com>
-->

# Meeting 13
*(June 20, 2024)*

## Participants:

- [Katharina Ettinger](https://github.com/EttingerK)
- [Shaheem Azmal M MD](https://github.com/shaheemazmalmmd)
- [Kaushlendra Pratap](https://github.com/Kaushl2208)
- [Vasudev Maduri](https://github.com/vasudevmaduri)
- [Samuel Dushimimana](https://github.com/dushimsam)
- [Abdelrahman Jamal](https://github.com/Hero2323)
- [Aaditya Singh](https://github.com/Aaditya-Singh78)
- [Akash Sah](https://github.com/Akashsah2003)
- [Divij Sharma](https://github.com/dvjsharma)
- [Rajul Jha](https://github.com/rajuljha)
- [Valens Niyonsenga](https://github.com/valens200)
- [Abhishek Kumar](https://github.com/abhi-kumar17871)

## Not Present:

- [Gaurav Mishra](https://github.com/GMishx)
- [Soham Banerjee](https://github.com/soham4abc)
- [Shreya Singh](https://github.com/SinghShreya05)
- [Anupam Ghosh](https://github.com/ag4ums)
- [Sahil Jha](mailto:sjha200000@gmail.com)
- [Shreya Gautam](https://github.com/ShreyaGautamm)
- [Ayush Bhardwaj](https://github.com/hastagAB)
- [Avinal Kumar](https://github.com/avinal)

## Overview

**Mentor:**
- [Kaushlendra Pratap](https://github.com/Kaushl2208): Shared general updates about the project.

**Contributors:**

- [Abdelrahman Jamal](https://github.com/Hero2323)
- Focused on Semantic Search to find closely related results.
- Evaluated a semantic transformer and developed a basic license identifier (Demo of current work).

- [Shreya Gautam](https://github.com/ShreyaGautamm)
- Was absent.

- [Aaditya Singh](https://github.com/Aaditya-Singh78)
- Following discussions with mentors, conducted a gap analysis and worked on the system architecture (Demo of current structure).

- [Abhishek Kumar](https://github.com/abhi-kumar17871)
- Developed SPDX 3.0 JSON format, noting that the validation tool does not support this format (Discussion with Linux community needed by Gaurav).

- [Akash Sah](https://github.com/Akashsah2003)
- Completed a UI for license expression including comment acknowledgements and related texts (Demo of current implementation).

- [Divij Sharma](https://github.com/dvjsharma)
- Implemented OAUTH through an API and is now working on copyright endpoints for user copyrights (Demo of OAUTH).

- [Rajul Jha](https://github.com/rajuljha)
- Modified the nomos scanner to include byte information, initiated work on custom keyword functionality, and revised GH Action workflow (Significant time reduction).

- [Valens Niyonsenga](https://github.com/valens200)
- Added unit tests for APIs related to License, Group, and Upload, and is now focusing on completing license API tests.
- Exploring FOSSology through YouTube tutorials.
4 changes: 4 additions & 0 deletions docs/2024/scheduler/updates/General/_category_ .json
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
{
"label": "General",
"position": 3
}