{"text_format":"1","workbook":"xlsx","n_sheets":4,"sheets":["Instructions","Main","Compare","Log"],"not_rendered":{"charts":0,"images":0,"macros":1,"external_links":0,"defined_names":0,"comments":0,"pivot_tables":0},"unopened":[],"bounds":{"document_bytes":16777216,"sheet_cells":100000,"rows_first":2000,"rows_last":500,"rows_between":2000,"halvings":0,"cell_chars":16384,"cell_head_chars":4096},"cells_cut":0,"cells_raw":0,"read":"whole","date_system":"1900"}

{"sheet":"Instructions","index":0,"n_rows":92,"n_cols":5,"rows_kept":92,"cut":false,"hidden":false,"merged":[]}
["PCA Evaluation Spreadsheet"]
["Overview"]
["This spreadsheet streamlines the Pair Comparison Analysis system by "]
[null,"Managing the order of comparisons, automatically presenting the next comparison to be performed;"]
[null,"Recording and organizing notes for each booklet step for each team; and"]
[null,"Recording the log of results from each comparison."]
["Maximum impact is achieved if the facilitor and left and right evaluators can see the screen during evaluation."]
[null,"Depending upon the seating arrangement, a second monitor may be useful."]
["The PCA Evaluation Spreadsheet performs the same function as moving booklets between stacks and recording findings on sticky notes."]
["When complete,"]
[null,"The Main worksheet contains the booklets order from lowest on top to best on the bottom, with all notes recorded and the original rank in column H (highest is best)"]
[null,null,"The final ordering of the Main worksheet corresponds to the order of the stack when done manually"]
[null,"The Log worksheet contains the entire history of the process, recording the comparisons in order, the booklets, the winner highlighted in green, the total +/- score and each +/- score by step"]
[null,null,"Each row of the Log worksheet contains the information from a comparison record"]
[null,null,"The history of comparisons by team can be extracted from the Log worksheet"]
[]
["Use"]
["Make sure that macros are enabled"]
[null,"Click the Test Macros button to the right"]
[null,null,"If a popup appears that says Macros Work!, click on OK to close the popup, you are ready to go"]
[null,null,"If no popup appears, macros are not enabled"]
[null,null,null,"First, look for a prompt to enable macros, enable them if the prompt has appeared"]
[null,null,null,"If you are not prompted to enable macros and the buttons do not work, enable macros"]
[null,null,null,null,"See Enabling Macros at the bottom of this page"]
["Startup"]
[null,"Save the spreadsheet as a new name"]
[null,"Switch to the Main Worksheet"]
[null,"Enter the booklet ids in column A"]
[null,null,"Enter the id of the lowest ranked booklet in row 3, then continue entering booklet ids in ascending order in the rows to follow"]
[null,"Begin comparison by clicking the Ready to Score button"]
[null,null,"The rows containing booklet Ids will turn to blue with white font"]
[null,null,"The original rank will appear in column H"]
[null,null,"The Compare spreadsheet will appear with the first two booklets ids"]
[null,null,"If this does not occur, click on an empty cell and click the Ready to Score button again.  "]
[null,null,null,"Don't proceed until the rows on the Main worksheet turn blue and the Compare spreadsheet automatically appears."]
["Comparing Booklets"]
[null,"When a booklet Id appears with no notes beneath it, look at the evaluations and booklets and make any relevant notes in the cells below it"]
[null,null,"The left side (pink) is the left reviewer, the right side (blue) is the right reviewer"]
[null,null,null,"The right side has the booklet that is currently higher ranked"]
[null,null,"These notes will be automatically displayed whenever a comparison involving the booklet occurs"]
[null,null,"Cells will automatically resize to meet the length of the notes"]
[null,null,"Suggested notes"]
[null,null,null,"Step 1: agreed upon score, how many blank entries"]
[null,null,null,"Step 2 - agreed upon score, focus and adequacy letters, KVP and Purpose"]
[null,null,null,"Step 3 - agreed upon score, how many blank entries"]
[null,null,null,"Step 4/5 - agreed upon score, how many improperly written entries, grid errors"]
[null,null,null,"Step 6  - agreed upon score, brief description of solution"]
[null,null,null,"Overall - agreed upon score"]
[null,"Use the pulldowns in column B to record comparison of each step"]
[null,null,"The total in row 10, column B will update with the score and the background color will match the color of the currently winning side"]
[null,"When a decision has been made for this comparison, click on Left Wins or Right Wins accordingly"]
[null,null,"The results are recorded on the Log worksheet"]
[null,null,"If the order of booklets has changed, the rows on the Main worksheet are swapped"]
[null,null,"The next two booklets to be compared will appear on the Compare worksheet"]
[null,null,null,"If this was the final comparison, the Main worksheet will appear and a pop-up saying that PCA is Done will appear"]
[null,"The current order can be viewed on the Main worksheet at any time"]
[null,"If a mistake has been discovered, use the Undo Previous Comparison button to return to the previous comparison"]
[null,null,"This can be done multiple times if the mistake was multiple comparisons ago"]
[null,null,"Notes that were entered are not lost"]
[]
["Notes"]
["Like any other time a spreadsheet is used, occasional saving of results is recommended."]
["If the spreadsheet is saved and closed, it will return to where evaluation left off upon reopening"]
[null,"Notes are saved when the Left Wins or Right Wins buttons are clicked, so interrupting during a comparison will lose new notes"]
["Notes can be entered directly into the Main worksheet, before the first appearance of the booklet in the Compare worksheet"]
[null,"This allows prepatory work, such as filling in the KVP and Purpose ahead of time"]
[null,"Notes entered directly into the Main worksheet are automatically save with the spreadsheet"]
["Notes that are updated during a comparison are saved"]
["In cases of extreme changes (e.g. adding or subtracting teams once PCA has begun), perform the following:"]
[null,"Copy, paste and delete lines in the Main worksheet to return the ordering to lowest to highest beginning in row 3"]
[null,"Don't allow any blank lines between team entries"]
[null,null,"This will preserve the comments alread entered"]
[null,"Click the Ready to Score button"]
[null,null,"A popup will appear asking for verification, click OK"]
[null,"Evaluation will restart with the booklets in rows 3 and 4"]
[null,null,"All history is deleted"]
[]
["Enabling Macros"]
[null,"Enabling macros varies with the version of Excel"]
[null,null,"2000 and 2003 - select Tools, then Macro, then Security, select Medium security, close and reopen and Excel will prompt for whether or not to allow macros"]
[null,null,"2007 - open spreadsheet, click the Office button (the round button), select Trust Center, then Trust Center Settings, select disable macros with notification"]
[null,null,null,"Close and reopen the spreadsheet and Excel will prompt for whether or not to allow macros"]
[null,null,"2010 and 2013 - open worksheet, select File, then Options, then Trust Center, then Trust Center Settings, select disable macros with notification"]
[null,null,null,"Close and reopen the spreadsheet and Excel will prompt for whether or not to allow macros"]
[null,null,"Versions later than Office 2011 for Mac - open Excel, select preferences,  select security and privacy, select disable all macros with notification"]
[null,null,null,"Open the spreadsheet and Excel will prompt for whether or not to allow macros"]
[null,null,"Office 2011 for Mac - open Excel, select preference, select security and privacy, select enable macros when you open a file"]
[null,null,null,"Open the spreadsheet and use it"]
[null,null,null,"When done with all PCA evaluations, it is recommended to reset the macro setting disable macros when you open a file"]
[null,null,"Office 2008 for Mac - has no macro support, use a different version of Office for Mac"]
[null,"There are other ways to enable macros for specific spreadsheets"]
[null,null,"See How to Run a Macro Even if Running Macros is disabled at https://www.exceltrick.com/how_to/enable-macros-in-excel/  for other options"]

{"sheet":"Main","index":1,"n_rows":2,"n_cols":8,"rows_kept":2,"cut":false,"hidden":false,"merged":[[0,0,0,4]]}
["Fill in Team names then click Ready to Score button on the right.  As you go, fill in step 1 score, step 2 description, step 3 score, step 4/5 score, step 6 description and overall score for each team from the Compare sheet or here."]
["Team","Step  1","Step 2","Step 3 ","Step 4/5","Step 6","Overall","Original Rank"]

{"sheet":"Compare","index":2,"n_rows":31,"n_cols":12,"rows_kept":31,"cut":false,"hidden":false,"merged":[[1,0,1,3],[0,0,0,3]]}
["Comparison"]
["Select right vs left scores from pulldowns.\nChanges to left or right data will be stored automatically when Left Wins or Right Wins is clicked."]
[null,"Right vs Left"]
["Step 1",null,null,null,null,null,null,null,null,4,3,{"$f":"(J4-4)*K4","v":0}]
["Step 2",null,null,null,null,null,null,null,null,4,3,{"$f":"(J5-4)*K5","v":0}]
["Step 3",null,null,null,null,null,null,null,null,4,3,0]
["Step 4/5",null,null,null,null,null,null,null,null,4,2.5,0]
["Step 6",null,null,null,null,null,null,null,null,4,3,0]
["Overall",null,null,null,null,null,null,null,null,4,3,0]
["Total",{"$f":"SUM(L4:L9)","v":0}]
[]
[]
[]
[]
[]
[]
[]
[]
[]
[]
[]
[]
[]
[]
["3 Left"]
["2 Left"]
["1 Left"]
["Even"]
["1 Right"]
["2 Right"]
["3 Right"]

{"sheet":"Log","index":3,"n_rows":1,"n_cols":1,"rows_kept":1,"cut":false,"hidden":false,"merged":[[0,0,0,8]]}
["Results Log"]