Sensor data annotations and quality check

Deutsche Bahn AG Konzernleitung (Bukr 10)

Generation of annotations on sensor data from the railway environment and quality check of the annotations

Deadline

Die Frist für den Eingang der Angebote war 2023-06-27. Die Ausschreibung wurde veröffentlicht am 2023-05-25.

Wer? Wie? Wo?
Geschichte der Beschaffung
Datum Dokument
2023-05-25 Auftragsbekanntmachung
Auftragsbekanntmachung (2023-05-25)
Objekt
Umfang der Beschaffung
Titel: Photogeologische Untersuchungen
Referenznummer: 23FEA67263
Kurze Beschreibung:
Generation of annotations on sensor data from the railway environment and quality check of the annotations
Metadaten der Bekanntmachung
Originalsprache: Englisch 🗣️
Dokumenttyp: Auftragsbekanntmachung
Art des Auftrags: Dienstleistungen
Verordnung: Europäische Union, mit GPA-Beteiligung
Gemeinsames Vokabular für öffentliche Aufträge (CPV)
Code: Photogeologische Untersuchungen 📦
Zusätzlicher CPV-Code: Photogeologische Untersuchungen 📦
Ort der Leistung
NUTS-Region: Berlin 🏙️

Verfahren
Verfahrensart: Verhandlungsverfahren
Angebotsart: Angebot für alle Lose
Vergabekriterien
Wirtschaftlichstes Angebot

Öffentlicher Auftraggeber
Identität
Land: Deutschland 🇩🇪
Art des öffentlichen Auftraggebers: Versorgungsunternehmen
Name des öffentlichen Auftraggebers: Deutsche Bahn AG Konzernleitung (Bukr 10)
Postanschrift: Potsdamer Platz 2
Postleitzahl: 10785
Postort: Berlin
Kontakt
Internetadresse: http://www.deutschebahn.com/bieterportal 🌏
E-Mail: rene.sambale@deutschebahn.com 📧
Telefon: +49 3029756738 📞
Fax: +49 6926520154 📠
URL der Dokumente: https://bieterportal.noncd.db.de/evergabe.bieter/api/external/deeplink/subproject/83de11f4-9873-42ca-9524-2f585a42f0ba 🌏
URL der Teilnahme: https://bieterportal.noncd.db.de/evergabe.bieter/api/external/deeplink/subproject/83de11f4-9873-42ca-9524-2f585a42f0ba 🌏

Referenz
Daten
Absendedatum: 2023-05-25 📅
Einreichungsfrist: 2023-06-27 📅
Veröffentlichungsdatum: 2023-05-30 📅
Datum des Beginns: 2024-01-01 📅
Datum des Endes: 2026-12-31 📅
Kennungen
Bekanntmachungsnummer: 2023/S 102-320589
ABl. S-Ausgabe: 102
Zusätzliche Informationen
Please note that Regulation (EU) 2022/576 amending Regulation (EU) No 833/2014 applies and companies subject to the sanction measures in Art. 5k of Regulation (EU) 2022/576 will be excluded from the procurement procedure.

Objekt
Umfang der Beschaffung
Bezeichnung des Loses: Lot 1: Annotation of sensor data
Losnummer: 1
Kurze Beschreibung:
1. Viewing and evaluating the sensor data
• Review of individual sensor data or sensor platform data provided in encrypted form by DB Netz AG:
- Lidar 3D point cloud data
- Radar data (as image files)
- Visual image data (resolution up to 20 Mio pixels; frame rates: up to 50fps; as image file)
- IR image data (resolution: VGA; frame rates: up to 30fps; as image file)
- GNSS data
• Checking of single sensor data or sensor platform data regarding the following criteria and documentation of
the outcome:
- Quality, e.g. image noise, occlusions, blurring, etc.
- Calibration, regarding the correct local synchronism of the reference systems of all sensors i.e. checking
whether all single sensor data of the same scene in 2D/3D space are locally superimposed.
• Immediate communication to the project team of DB Netz AG in case of:
- Data quality problems
- Content errors
- Calibration errors
- Other ambiguities
2. Annotation
• Annotation of the classes listed in the attachments using semantic segmentation, 2D and 3D bounding boxes
and/or 2D, 3D spline curves/polylines and/or 2D, 3D poly-gons (for example: person, train, rails, etc.).
• The annotation requirements provided in the attachments should be able to be met by the applicants. General
requirements as well as object-specific requirements shall be considered. Note, that the requirements may
slightly change during the contract pe-riod.
• Flexible annotation of further classes, which can be defined by DB Netz AG during the contract period.
• Creation of an annotation guide, by means of which the annotation and the contents of the metadata can be
traced.
• The annotation data should be provided in a standardized format. For this purpose, the ASAM openLabel
V1.0.0 format (or future releases, see attachments) shall be used. An example of its use is provided in the
attachments. If newer versions of the standard are released, a change can also be made in the project.
3. Statistics regarding the data
• The contractor visualizes and describes the status of the project to the client at regu-lar intervals.
• This includes, among other things: a list of all labeled objects and object classes; number of annotated data vs.
data still to be annotated, etc.
4. Review of the data
• The client (i.e., DB Netz AG) must be provide the possibility of reviewing annotated data sets. Suitable tools
should be available to the contractor for this purpose.
• The provision of web- or browser-based tools is preferred.
• These tools must have a comment function that allows the client (i.e., DB Netz AG) to leave comments on the
annotations.
• The contractor must be able to integrate the comments of the quality check results, by providing an interface or
software tool to other companies (i.e. lot 2) for commenting.
5. Annotation accuracy and internal quality control
• The annotation accuracies (for example pixel tolerance) are agreed on a class- and sensor-specific basis and
are documented in the requirements
• The applicant must present a concept or process for internal quality assurance/con-trol. This means that all
data must go through an internal quality check process after the internal annotation process. This is to ensure
the highest possible quality.
6. Transmission of the annotation results
• Transmission of the annotations in a jointly agreed rhythm.
7. Integration of the results from the quality inspection
• The annotation results (after internal quality assurance) are checked by another com-pany
• The errors found in the annotation data must be corrected.
• This is done iteratively until the quality of the data meets the specifications. The ear-lier the quality
specifications are meet, the higher is the rating for the work done.
• The quality check process is described in detail in the following chapters.
8. Data security requirements
• Encrypted data transport and dispatch.
• Deletion of the data after completion of the project.
• Ensure compliance with the GDPR when processing personal data through the DB data processing agreement
["Auftragsdaten-Verarbeitungs-Vereinbarung" (AVV)].
• Viewing, processing, and using the data exclusively for the purpose defined by DB Netz AG.
9. Data anonymization (optional)
• Anonymization of the faces and vehicle plates in the camera images.
Estimated and maximum quantities or estimated and maximum values
The estimated quantity of services that will be called for during the term of the framework service agreements
(estimated quantity) is:
for lot 1: 20.000.000 Annotations
The maximum amount of services that may be called for during the term of the framework service agreements
is:
for lot 1: 25.000.000 Annotations
Beschreibung der Verlängerungen:
The Client has the option to extend the Framework Service Agreement 2 times by 12 months per extension.
Bezeichnung des Loses: Lot 2: Quality check of annotations
Losnummer: 2
Kurze Beschreibung:
This task involves checking the annotation results of another company. The annotation company (i.e. lot
1) provides an interface for reviewing the annotations. Hence, the quality check company do not need own
software tools for reading the data as well as the associated annotations and providing the comments.
Nevertheless, own computer hardware, internet access, and properly trained employees should be available. If
the company is able to check the results as well automatically, this would be a benefit.
The annotation quality check includes several subtask packages:
1 Familiarize with the software tool provided by the annotation company
• Familiarize the employees that should check the quality of the annotations with the tool of the annotation
company. A user manual and support will be provided.
2 Documentation of the annotation errors.
• Documentation of the annotation errors in the agreed format.
3 Reviewing the reworked annotation results.
• The reworked results must be checked by the company according to the quality as-surance process, outlined
in chapter "Quality assurance process check".
4 Providing of results
• Results need to be provided within a jointly agreed frequency.
• Listing and documentation of statistics on errors found. This means that it must be documented (human
readable format with examples, i.e., pictures) and evaluated which types of errors occur and in which object
classes or attributes they occur most frequently.
• The error rate must be determined for each sequence. Documentation and descrip-tion of systematic errors
should be provided in human-readable format, including a description (e.g., word document) and visualized
examples (e.g., pictures, screen-shots, etc.).
5 Data security requirements.
(see in attachments).
for lot 2: 20.000.000 Annotations
for lot 2 25.000.000 Annotations

Rechtliche, wirtschaftliche, finanzielle und technische Informationen
Bedingungen für die Teilnahme
Befähigung zur Berufsausübung:
- Bidder's self-ceclaration (The form is available on the procurement portal. See Annex B3 "Bidder's selfceclaration")
- Non-disclosure Agreement (The form is available on the procurement portal. See Annex B5 "Non-disclosure
agreement")
- Extract from the Commercial Register
- Language - Meetings (German or English)
- Language - administrative processes (German)
Wirtschaftliche und finanzielle Leistungsfähigkeit:
- Bank statement with a statement on the general financial situation (especially liquidity). This must not be older
than 3 months.
- Credit report such as Bürgel, Creditreform, Dun & Bradstreet or equivalent. A credit report that is clearly
below average compared to the industry value can lead to exclusion. This information must not be older than 3
months.
- Liability insurance: Please provide proof of liability insurance with information about the insurer, the amount of
coverage and the validity
Technische und berufliche Fähigkeiten:
- General information about the company: Please present your company briefly and concisely. Please address
the following points in particular:
- Naming year of foundation
- What is the company's legal form?
- What is the shareholder structure of the company?
- Have there been any far-reaching changes in the shareholder structure in recent years? And if so, which
ones?
- Please explain your company structure and business areas.
- Experience, knowledge, competences: Applicant must have relevant experience in annotation and/or quality
review of sensor data. Applicant must demonstrate a history of past projects in at least one area.
- The applicant must have suitable hardware and software to perform the required tasks. The hardware and
software should be described together with their main functionalities so that suitability can be checked.
- The applicant must have trained personnel who can perform the work packages.
- Contact person during service provision / during the contract period: The Applicant undertakes to appoint a
central representative and a deputy to the Client, who will be available and contactable Mon - Fri between 9
a.m. and 4 p.m. CET. In consultation also outside this time. A self-declaration is sufficient.
- Own resources: The contractor must perform the annotations or quality check of the annotations with trained
personnel and, if necessary, its own software programs. Proof of the number of qualified annotators or quality
checkers to which the applicant has access (own employees and contracted employees of other companies).
- The applicant must have a suitable quality management system. All work steps are to be deposited with a
suitable process. The processes are to be presented.
- The applicant must be able to statistically evaluate and visualize the status of the work (annotations, or the
results of the quality check).
- The applicant must be able to store and process the data on servers in the EU. The data may not be
transferred to servers outside the EU.
- Data transfer: In case of a future order, the transfer of the data takes place by uploading the data by the
contractor into the data platform of the client.
Furthermore, it is also possible that the results are provided on a server of the contractor and the client
downloads them. The upload or download takes place via the protocol SFTP (Secure File Transfer Protocol) or
via a browser-based web application via HTTPS (Hypertext Transfer Protocol Secure). The Contractor must be
able to guarantee options for secure data transfer.
- All electronically submitted documents - which are not annotated data - must be in a PC-readable format.
Liste und kurze Beschreibung der Regeln und Kriterien:
- All documents must be submitted electronically only
- All documents required in Annex A (Bidding Terms) and Annex B1 (Suitability matrix) must be submitted.
Failure to submit the required declarations/documents may lead to exclusion from the further award procedure.
- Only those candidates or bidding consortia who submit the evidence required in Annex B1 (Suitability matrix)
in full, meet the minimum requirements stated and are thus suitable to provide this service will be considered for
further selection and invited to submit a bid.
- The time of the upload and the submission in the Deutsche Bahn AG bidder portal are always decisive for
compliance with the deadlines
Auftragsausführung
Rechtsform der Gruppe von Wirtschaftsteilnehmern, an die der Auftrag vergeben werden soll:
Bidding consortium under German law or equivalent. The members of the bidding consortium must be
jointly and severally liable and must appoint an authorised representative when submitting the application to
participate.

Verfahren
Rechtsgrundlage: 32014L0025
Anzahl der in Betracht zu ziehenden Teilnehmer: 5
Zeitpunkt des Eingangs der Angebote: 10:00
Sprachen, in denen Angebote oder Teilnahmeanträge eingereicht werden können: Deutsch 🗣️
Englisch 🗣️
Gültigkeitsdauer des Angebots: 2024-01-31 📅
Vergabekriterien
Qualitätskriterium (Bezeichnung): Technical criteria
Qualitätskriterium (Gewichtung): 50 %
Kostenkriterium (Name): Price
Kostenkriterium (Gewichtung): 50 %

Öffentlicher Auftraggeber
Kontakt
Kontaktperson: Sambale, Rene
Dokumente URL: https://bieterportal.noncd.db.de/evergabe.bieter/api/external/deeplink/subproject/83de11f4-9873-42ca-9524-2f585a42f0ba 🌏
Name des öffentlichen Auftraggebers: FEA3 - Beschaffung Beratung, Kommunikation und Sonstige Dienstleistungen
Postanschrift: Caroline-Michaelis-Str. 5-11
Postleitzahl: 10115
Land: Berlin 🏙️

Ergänzende Informationen
Körper überprüfen
Name: Vergabekammer des Bundes
Postanschrift: Villemomblerstr. 76
Postort: Bonn
Postleitzahl: 53123
Land: Deutschland 🇩🇪
Informationen zu Fristen für Nachprüfungsverfahren:
If the award has already been validly made, it can no longer be challenged before the Public Procurement Tribunal (Section 168 (2) sentence 1 ARC). The award may only be made 10 calendar days after the notification of the award decision has been sent by fax or e-mail or 15 calendar days after the notification of the award decision has been sent by post (Section 134 (2) ARC). Furthermore, the admissibility of an application for review requires that the alleged infringements of the award decision were notified within 10 calendar days after knowledge or - insofar as the infringements of the award decision are recognisable from the notice or the award documents - by the expiry of the participation or bidding period (Section 160 (3) sentence 1 nos. 1 to 3 ARC). An application for review is also inadmissible if more than 15 calendar days have elapsed after receipt of the contracting authority's notification that it does not intend to remedy a complaint (Section 160 (3) sentence 1 no. 4 ARC). Furthermore, reference is made to the time limits specified in Section 135 (2) ARC.
Mehr anzeigen
Quelle: OJS 2023/S 102-320589 (2023-05-25)
Neue Beschaffungen in verwandten Kategorien 🆕
Verwandte Suchen 🔍
Region:
Deutschland Berlin Berlin Berlin
Produkte/Dienstleistungen:
Dienstleistungen von Architektur-,... Dienstleistungen von Ingenieurbüros Wissenschaftliche und technische... Geologische, geophysikalische und... Geologische, ozeanografische und... Geologische Untersuchungen Photogeologische Untersuchungen