Loading...
For the purposes of this Chapter 22J, the following definitions shall apply:
“AI” means Artificial Intelligence.
“AI Technology” means logical and physical technology that uses Artificial Intelligence.
“Algorithms” means a set of rules that a machine follows to generate an outcome or a decision.
“Artificial Intelligence” means an engineered or machine-based system that varies in its level of autonomy and that can, for explicit or implicit objectives, infer from the input it receives how to generate outputs that can influence physical or virtual environments.
“Chatbot” means a computer program that simulates conversations.
“CIO” means the City’s Chief Information Officer, or designee.
“City” means the City and County of San Francisco.
“COIT” means the Committee on Information Technology or one of its committees.
“Data” means information prepared, managed, used, or retained by a department or employee of the City or a data user relating to the activities or operations of the City.
“Department” means any unit or component of City government, including but not limited to boards and commissions, departments, offices, agencies, or officials.
“Department Head” means the head of a Department, or designee.
“DT” means the Department of Technology.
“Inventory” means the information collected and published in accordance with Section 22J.3.
“Training Data” means the dataset that is used by a machine learning model to learn the rules.
(Added by Ord. 288-24, File No. 241022, App. 12/19/2024, Eff. 1/19/2025)
(a) Chief Information Officer.
(1) Within six months of the effective date of this Chapter 22J, the CIO shall collect the data requested under subsections (b)(1)-(22) from Departments using AI technology, and begin publishing the Inventory responses on the DataSF platform.
(2) Within one year of the effective date of this Chapter 22J, the Inventory shall be complete, including any and all AI technology used by the City. In addition, within one year of the effective date, the CIO shall update the Inventory with any AI technology that the City is in the process of purchasing, borrowing, or receiving as a gift, with or without the exchange of compensation or other consideration before acquiring the technology and/or putting the technology into use. If the technology is never obtained or no longer used, it shall be removed from the Inventory.
(b) Department Head. The Department Head shall disclose and submit to the CIO for inclusion on the Inventory the AI technologies the Department has procured, borrowed, or received as a gift, with or without the exchange of money or compensation, and for each technology shall disclose the following information:
(1) Name of the technology and vendor;
(2) A brief description of the technology’s purpose and function;
(3) The intended use of the technology;
(4) The context or domain in which the technology is intended to be used;
(5) The data used to train the technology;
(6) An explanation of how the technology works;
(7) The data generated by the technology;
(8) A description of what the technology is optimizing for, and its accuracy, preferably with numerical performance metrics;
(9) Conditions necessary for the technology to perform optimally;
(10) Conditions under which the technology’s performance would decrease in accuracy;
(11) Whether testing has been performed to identify any bias in the technology such as bias based on race, gender, etc., and the results of those tests;
(12) A description of how and where people report bias, inaccuracies, or poor performance of the technology;
(13) A description of the conditions or circumstances under which the technology has been tested;
(14) A description of adverse incident monitoring and communication procedures;
(15) A description of the level of human oversight associated with the technology;
(16) A description of whether the data collected will or can be used for training of proprietary vendor or third-party systems;
(17) The individuals and communities that will interact with the technology;
(18) How the information or decisions generated by the technology could impact the public’s rights, opportunities, or access to critical resources or services;
(19) How people with diverse abilities will interact with the user interface of the technology and whether the system integrates and interacts with commonly used assistive technologies;
(20) Whether the technology is expected to replace any jobs currently being performed by human beings or could impact the employment and/or working conditions of City workers;
(21) Why it is important for the City to use the technology; and
(22) Potential risks of the technology and steps that would be taken to mitigate these risks.
(c) COIT, at the recommendation of the CIO, may modify the information requested under subsection (b).
(d) Exceptions. The requirements set forth subsections (a) and (b) shall not apply to the following uses. COIT, at the recommendation of the CIO, may reevaluate and modify these exceptions:
(1) Internal Administration: AI technology solely used to improve internal administrative processes that does not affect rights, staffing decisions, or make substantive changes affecting Department decisions, rights, or services. Examples include systems for internal data management, coding support, data analysis and visualization, graphic design and image creation, automation of manual processes, speech-to-text and transcription, email sorting, data entry, file management, document organization, grammar and spellcheck and other text editing or text formatting.
(2) Internal Cybersecurity: AI technology solely used for internal cybersecurity purposes and that does not involve surveillance of the public, decision-making, or similar actions otherwise impacting the public’s rights or safety, including intrusion detection, threat monitoring, and other cyber defense systems.
(e) Each Department shall:
(1) Complete and return the Inventory to the CIO;
(2) For subsections (b)(1)-(16), it is anticipated but not required that the department will obtain the information requested directly from the AI Technology Vendor;
(3) For subsections (b)(17)-(22), it is anticipated but not required that the Department will assess the intended use of the technology to answer the questions for the inventory;
(4) Notify DT of any updates to published Inventory information; and
(5) Participate in and facilitate a timely and accurate response to all information in Section (b)(1)-(22).
(f) The Controller shall conduct an annual review of all Department inventory responses and by letter addressed to the Board of Supervisors confirm each Department’s compliance or noncompliance with this Section 22J.3.
(g) In addition to the Inventory, the CIO shall submit to the Board of Supervisors and shall make available on the DataSF platform an AI Technology Report for all AI technologies used by the City within 12 months of the effective date of this Chapter 22J, and every two years thereafter. For each report the CIO submits to the Board of Supervisors, the CIO shall include a resolution to accept the report.
(h) The requirements of this Chapter 22J are in addition to any requirements in Chapter 19B, “Acquisition of Surveillance Technology.”
(Added by Ord. 288-24, File No. 241022, App. 12/19/2024, Eff. 1/19/2025)
(a) If a person alleges that a Department has violated this Chapter 22J by failing to include an AI technology in its inventory response, the person shall give written notice of the alleged violation(s) to the CIO, and the CIO shall send a copy of the alleged violation to the Department. The Department shall have an opportunity to correct such alleged violation(s) within 30 days of the CIO’s receipt of the notice.
(b) The CIO shall quarterly report to the Board of Supervisors the notices of alleged violation that the CIO deemed valid and were not cured within 30 days of the notice.
(c) If the report described in subsection (b) identifies any Departments out of compliance with this Chapter 22J, then the Board of Supervisors shall calendar within 60 days of receiving the quarterly report a hearing on each such Department’s noncompliance in the Government Audit and Oversight Committee, or successor committee, of the Board of Supervisors, at which hearing the Department Head shall report on the Department’s plan for coming into compliance with this Chapter 22J.
(d) This Section 22J.4 shall not preclude the use of any other City process or program, such as the Controller’s Whistleblower Program, for raising an issue concerning compliance with this Chapter 22J.
(Added by Ord. 288-24, File No. 241022, App. 12/19/2024, Eff. 1/19/2025)
In enacting and implementing this Chapter 22J, the City is assuming an undertaking only to promote the general welfare. It is not assuming, nor is it imposing on its officers and employees, an obligation for breach of which it is liable in money damages to any person who claims that such breach proximately caused injury.
(Added by Ord. 288-24, File No. 241022, App. 12/19/2024, Eff. 1/19/2025)