August 16th
Attendees: Xinyu, Joanna, Anton, Don
Minutes
-
FYI; Glen is out this week.
-
Status Update
-
Arthur - Still stuck on Issue w/ Windows Nodes in mbedTLS (TFC-129
<https://linaro.atlassian.net/browse/TFC-129>). Bringing in
resources from Ryan’s team. No updates yet
-
Paul - meeting yesterday w/ Joanna and team to outline plan for MISRA
reporting. Got some guidance and Paul is moving forward.
-
Do we need some minutes/requirements to document expectations?
-
ACTION: Joanna to put a short email note together on the
agreements in the meeting and send to Paul, and team
-
TFC-313 <https://linaro.atlassian.net/browse/TFC-313>: Arm TF-A
member requesting CI staging area to create jobs and TFC JIRA access to
comment on tasks
-
Add Harrison to the Gerrit group. He should be able to submit and
approve new jobs for the Staging CI. He still needs to be
added to a GitHub
team member, Joanna could do it?
-
Plan to update the OpenCI User Guide
<https://tf-ci-users-guide.readthedocs.io/en/latest/#brief-description-of-th…>
per Joanna’s request
-
Don created two new tickets based upon 1:1 w/ Hauke
-
TFC-311 and TFC-312
-
Currently at the bottom of the backlog. Consider moving up when
Shebu/Matteo are back
-
Joanna: Yes agree lots of “nuances” in the CI. Hard to prioritise
these things but agree would be helpful
-
Second rack all pieces are in, now preparing to build out
-
AOB
-
TFC-275: Chrome tests. Arthur working on this and has started, but
still in progress as other
-
Anton: LAVA logs accessed by anyone, now closed? TFC-195
-
Agreed to close-not done.
-
Need to re-open ticket as a newfound need was found on per patch
basis.
-
ACTION: Don Re-Open TFC-195, Done
-
ACTION: Anton add a note to TFC-195 explaining the need to reopen
-
Question on Juno R2 boards / Swap
-
Linaro LKFT has a need for these for kernel upstreaming testing,
would it be possible to swap in some other R0/1s.
-
Joanna to discuss w/ Matteo when he returns.
-
Will it be in LAVA farm for others to use? If so would be easier.
-
ACTION: Don have Anmar send explanation to Joanna
<end>
*
August 9th
Attendees: Xinyu, Joanna, Anton, Glen, Don
Minutes
*
FYI; Glen is out next week.
*
Status UpdateArthur - still narrowing down the production issue with
MbedTLS dropping connections. Has been testing with updated JVM,
matching whats on stage as well as adjusting the heap, TCP stack on
the server.
o
*
Paul - Able to use Jenkins Plugin showing some results with that.
Able to see 6000+ issues reported. This is quite large and that
number needs to be tuned/filtered down into something manageable
that ARM is concentrating on. Paul also needs to know the # of
configurations this should be run on. Need more insight from ARM
on that as it may impact performance.
*
Other priorities in Queue
o
Dan Handley sent in a Jira ticket
(https://linaro.atlassian.net/browse/TFC-308
<https://linaro.atlassian.net/browse/TFC-308>) ClickJacking
vulnerability. Resolved
*
AOB?
o
TF-M flash testing. Start using more FVP vs hardware. Some
issue with log files are not available (see:
https://linaro.atlassian.net/browse/TFC-195
<https://linaro.atlassian.net/browse/TFC-195>) need them for FVP
logs.
o
Would migrating things over to FVP cause backups in Queues?
This could be a phase in issue. Doing it on nightly, vs per
patch. Team should be aware of this happening as they may see
queues start to back up.
o
Don, met with Hauke. Going to create a few tickets. Looking at
this https://tf.validation.linaro.org/scheduler/
<https://tf.validation.linaro.org/scheduler/>it was hard to know
what tests were running on what board, and some of the
descriptions was pretty cryptic. Don will log a few tickets on
this issue.
o
Summary of F2F meeting w/ TF & Linaro Systems team. Discussion
on potential CI infrastructure upgrades, Toolchains,
resourcing. Joanna has interest in other more recent FVP
models, beta state (early availability) and would like to see
about getting some of this working. The access should be
available to the testing, but not available to the general public.
*
--
Linaro <http://www.linaro.org>
Glen Valante | /Sr. Technical Program Manager/
T: +1.508.517.3461 <tel:1617-320-5000>
glen.valante(a)linaro.org <mailto:glen.valante@linaro.org> | Skype:
gvalante <callto:gvalante>
*August 2nd*
Attendees: Xinyu, Ben, Anton, Glen
*Minutes*
* FYI; Holidays - Lots of people are out the next few week. We can
have the meetings and address any issue.
* Status Update
o Arthur
+ Working on TFC-129 mbedtls Windows build node in Production.
Various debugging found an error in the logs -
"java.io.EOFException". Looking into this
o Paul
+ expanding the Prototype job; its now a jenkins matrix job
for 2 TF-A configurations. This can be extended to more
configurations and will need to get feedback from ARM on how
many configurations will be needed based on the performance.
+ Worked with Kelly to make sure that AWS-based private docker
repo works as expected, and switched the prototype to it
o Further investigation on ECLAIR Jenkins plugin - investigation
with Bugseng. Getting Java Exceptions, need to debug.
* Other priorities in the Queue
o Dan Handley sent in a Jira ticket
(https://linaro.atlassian.net/browse/TFC-308) ClickJacking
vulnerability. Ben is on the issue, talking to Philip in IT.
* AOB
o No other topics
--
Linaro <http://www.linaro.org>
Glen Valante | /Sr. Technical Program Manager/
T: +1.508.517.3461 <tel:1617-320-5000>
glen.valante(a)linaro.org <mailto:glen.valante@linaro.org> | Skype:
gvalante <callto:gvalante>
July 26th
Attendees: Don, Shebu, Matteo, Xinyu, Ben, Anton, Antonio
Actions:
-
Don: Follow up with Paul on open tickets vs MISRA enablement Update:
Update from Paul below. .
-
Don: Ask for update on TFC-129 from Arthur. Update: update from Arthur
below
Minutes:
-
Status Update
-
Arthur
-
MbedTLS; After the Production Upgrade, Windows build nodes still
have issues. Currently looking at other debug techniques - disabling
the ping thread
<https://wiki.jenkins.io/display/JENKINS/Remoting+issue>. Note
problem does not occur on Stage. As part of debug, a rebuilt AMI that
removed Windows defender has helped performance.
-
TFC-75: Repositories synchronization based on Gerrit topics; need
1+ week to resolve
-
TFC-275 Enable TF-A tests on Chromebook
-
Paul
-
Paul - “Over the last week, I worked on prototyping an actual
Docker image to run ECLAIR processing in our Jenkins (on
staging). My focus
was trying to go as "deep" as possible,trying to identify any possible
issues or contingencies. I'm glad to report that it worked
largely well, in
articular, there was no further issues with the license
server, everything
works as expected (at least by me). Already somewhat cleaned
up version of
my prototype job is available at:
https://ci.staging.trustedfirmware.org/job/pfalcon-tf-a-eclair/ “
-
TFC-7 Code Coverage - Last task is Docs - PR
<https://review.trustedfirmware.org/c/ci/tf-ci-users-guide/+/16022>
posted
-
Background tasks - TFC-191, TFC-193, TFC-263 are Pauls self-posted
"background" task.
-
Other priorities in the Queue
-
TFC-247: Mirror TF-M, TF-A, TS projects into GitHub - Arthurs next
task
-
TFC-222: Make sure someone at higher level is working to provide a
work-around for the “click-thru” constraints. Moved this issue to
Blocked. Need to go back to Linaro management to get progress
as this was
being addressed at a higher level.
Hello All,
The server will be offline to start a maintenance window on 2022-07-22 at
20:00 UTC. Jenkins will be put into "Shutdown Mode" at 2022-07-22 18:00
UTC to stop accepting new jobs and allow executing tasks to complete.
This downtime is required to add a plugin to Jenkins to support new
functionality required for a service being developed. The version of
Jenkins and the plugins currently being run will not be changing.
Emails will be sent prior to and following the upgrade to provide status
reports.
Start: 2022 07-22 18:00 UTC
End: 2022-07-22 22:00 UTC
Regards,
--
Kelley Spoon <kelley.spoon(a)linaro.org>
July 19th
Attendees: Don, Shebu, Matteo, Xinyu, Ben, Anton, Antonio
Actions:
-
Don: Follow up with Paul on open tickets vs MISRA enablement Update: Don
sent inquiry to Paul. Will update once we sync up.
-
Don: Ask for update on TFC-129 from Arthur. Update: Don sent inquiry to
Arthur, will update once I hear back.
Minutes:
-
MISRA Enablement
-
Licence server up and running. Allows Paul to leverage a licence
locally to advance on his work. It’s quite easy to break. It has secure
storage - if tampered, it breaks the licence server. Requires Bugseng to
fix when it breaks. No security - open to internet.
-
Next steps - Paul starting to get Jenkins agent images built.
Eclair should be enabled on staging server and Paul can then
move forward.
-
Ticket TFC-285 is systems work
-
Paul on TFC-287 in Milestone 2
-
Blocker Review
-
Only one blocker - on Kelley’s plate TFC-236
-
Want to make sure Paul status is understood and focus on the open
tickets vs MISRA.
-
Don: Follow up with Paul on open tickets vs MISRA enablement
-
MBed TLS windows issue status - TFC-129, Arthur may have found root
cause.
-
Don: Ask for update on this ticket from Arthur.
-
Assigned TFC-275 to Arthur - moved to SC Approved (Enable Google Tests)
<end>
July 12th
Attendees: Don, Anton, Ben, Glen, Xinyu, Shebu, Matteo
Minutes:
-
Infrastructure upgrade completed. No issues so far.
-
Testing on mbed TLS is currently passing; windows platform was failing
-
TFC-297 - Monitoring jobs that are waiting for jobs to come back from
lava
-
Updating the web site that goes to read the docs. Once the link is
available, Don can update docs.
-
Misra - License server. Issues with trying to get the license server
running on Docker, but cant run on a headless server.
-
Meeting setup for Thursday. Still waiting for the detachable
license. If no progress happens this week, please escalate to
Matteo/Don.
-
Meeting w/ Team - Ben, Kelley & Paul tomorrow. Focus on ways to pull
schedule in.
-
Issue - TFC-299 Gerret Account Issue - Kelley Spoon
<kelley.spoon(a)linaro.org> has that issue and will be on line shortly.
-
Adding the ST Board, still blocked on awaiting for the PDU hardware.
-
Blockers - 4 blockers, awaiting testing on the updated Production.
Expect these should close when testing is completed.
-
Glen on Holiday next week.
-
Joanna out until early August, contact Matteo with any TF-A related
topics.
Hello All,
The server will be offline to start a maintenance window on 2022-07-08 at
01:00 UTC. Jenkins will be put into "Shutdown Mode" at 2022-07-07 23:00
UTC to stop accepting new jobs and allow executing tasks to complete.
This downtime is required to execute an upgrade to Jenkins 2.332.3. The
upgrade will address several security advisories for Jenkins core and its
plugins and will also bring the server to feature parity with staging.
Emails will be sent prior to and following the upgrade to provide status
reports.
Start: 2022 07-08 01:00 UTC
End: 2022-07-08 03:00 UTC
Regards,
--
Kelley Spoon <kelley.spoon(a)linaro.org>
July 5th
Attendees: Joanna, Don, Anton, Ben, Glen, Xinyu, Shebu, Matteo
Minutes:
-
Action Items:
-
AI: Anton to see about getting 1-2 spares MPS boards
-
Boards processed - and should be in progress to be sent.
-
Anton - boards have been shipped and should be in Cambridge. Says
they arrived in July 1st.
-
STG-3444 <https://linaro.atlassian.net/browse/STG-3444> Lab has
received the board, found another one and will setup 2 boards
as spares.
-
AI: Don to follow up with Julius about setting up tests.
-
Don to send out email - done.
-
New issues with another STM -03 board.
-
AI: Glen to reach out to ST and see about getting additional boards.
-
They have new tests that do not use the flash. Antonio De Angelis
<Antonio.DeAngelis(a)arm.com> is changing the tests to only run the
test once a day, not every test.
-
Upgrade to production today.
-
No news as of meeting, Kelley Spoon <kelley.spoon(a)linaro.org> is not
online today.
-
Misra
-
Systems team has license server almost up. They currently have this
in docker and we’re still waiting for the actual licenses. After that,
build the jenkins image.
-
Get a weekly meeting with Ben and Paul.
-
AI: Glen to setup this meeting
-
TFC-295 - Ben - will dispatch ticket
-
Docker Images, load still seems quite bad.
-
Killing TF-A jobs and the loads get higher. The FVP jobs are working
ok, but there are jobs that are jamming up the queue. The queue is going
down, but pretty slowly.
-
Seeing a lot of jobs, not finishing very quickly.
-
Seeing some FVP jobs go into an infinity loop as they have no time
out.
-
Ben will put the queue in maintenance and clear out the jobs.
-
All blockers are currently related to an infrastructure upgrade.
Hi All,
Please find the meeting minutes from yesterday below
Don
Attendees: Joanna, Don, Antonio, Ben, Glen, Xinyu, Shebu, Matteo, Dan
Handley
Minutes:
-
Upgrade for Production has been pushed to July 5th. Arthur She
<arthur.she(a)linaro.org> is on holiday and it makes sense to have him
back for testing.
-
Lab Hardware - Back boards?
-
Lab team has asked if there are any MPS boards?
-
AI: Anton to see about getting 1-2 spares
-
Recent issue TFC-293 <https://linaro.atlassian.net/browse/TFC-293> -
Flakey stm32l562e
-
Arthur has 2 and will ship them when he returns home at the end of
July.
-
Joanna - is anyone doing anything with the Chrome Books.
-
Google should be creating boot tests and any other tests they
would like. AI: Don to follow up with Julian about setting up
tests. Also bring up at the board meeting. (Shebu brought up w/
NXP in the past.)
-
Jira https://linaro.atlassian.net/browse/TFC-275 logged for what
needs to be setup.
-
Shebu - Its the partners responsibility to enable the testing.
-
Juno’s using netboot?
-
If your changing the firmware, netboot will not help.
-
Dean & Ben to follow up with a discussion about the details, may
be able to reduce the frequency of
-
mbedTLS
-
Shebu - Hosting mbedtls website content in tf.org
-
Old company removed all content, new company will need to redeploy.
-
Dean - Is it possible to migrate MbedTLS to TF.org domain?
-
TF is all hosted off GitHub (
https://github.com/TrustedFirmwareWebsite/website )
-
Current: https://www.trustedfirmware.org/projects/mbed-tls/
-
There is legacy content, knowledge base for coding style, examples.
-
Ben - convert the content as a pull request.
-
Shebu - readthedocs is more of a long term, short term is just to
drop it in somewhere.
-
Old Site - https://github.com/Mbed-TLS/polarssl_site (Private)
-
Blockers - cleaned up. 1 waiting for Paul to get back, 4 waiting on
Production update
-
Misra
- Updated Plan Milestones w/ dates.
