Data quality checks before upgrading to V6.0 - Revision history

Alnaucler at 21:30, 12 November 2016

2016-11-12T21:30:36Z

← Older revision		Revision as of 23:30, 12 November 2016
Line 86:		Line 86:

	===Missing Local ID (DEF, items, Auxiliary data and Task)(mandatory)===__NOEDITSECTION__		===Missing Local ID (DEF, items, Auxiliary data and Task)(mandatory)===__NOEDITSECTION__
	In some database also Form ID and the items' local ID have been missing. If Form ID is null then the [[Empty Reconciliation Tab#Case 2 The tab is highlighted and no error message in the log \| '''Reconciliation tab will be empty''']] and it is not possible to see which ''Action'' was used. ~~The~~ [[Missing Local ID\|queries]] ~~also include~~ Auxiliary data and Task.		In some database also Form ID and the items' local ID have been missing. If Form ID is null then the [[Empty Reconciliation Tab#Case 2 The tab is highlighted and no error message in the log \| '''Reconciliation tab will be empty''']] and it is not possible to see which ''Action'' was used. On this page you find [[Missing Local ID\| MySQL queries]] for checking if you need to populate IDs including Auxiliary data and Task.

	This '''[[Fieldreport ID and Dates \| page ]]''' provides an overview of the fields in the table ''fieldreport''.		This '''[[Fieldreport ID and Dates \| page ]]''' provides an overview of the fields in the table ''fieldreport''.

Alnaucler at 21:27, 12 November 2016

2016-11-12T21:27:53Z

← Older revision		Revision as of 23:27, 12 November 2016
Line 73:		Line 73:
	Due to changed behaviour of migration/import scripts in version 5.08.02 and a bug in 5.08.04 approval information may be missing. Note that ''Last updated'' gets updated e.g. when templates are switched and should not be used for setting Approved Date. If the Data Entry Form that misses Approved Date is an Activity or Education then you might be able to use End date [[Missing approval information\|(query)]].		Due to changed behaviour of migration/import scripts in version 5.08.02 and a bug in 5.08.04 approval information may be missing. Note that ''Last updated'' gets updated e.g. when templates are switched and should not be used for setting Approved Date. If the Data Entry Form that misses Approved Date is an Activity or Education then you might be able to use End date [[Missing approval information\|(query)]].

	This '''[[Fieldreport ID and Dates \| page ]]]''' provides an overview of the fields in the table ''fieldreport''.		This '''[[Fieldreport ID and Dates \| page ]]''' provides an overview of the fields in the table ''fieldreport''.

	===Missing Date of Information (mandatory)===__NOEDITSECTION__		===Missing Date of Information (mandatory)===__NOEDITSECTION__
Line 83:		Line 83:

	'''Note''' that ''Last updated'' gets updated e.g. when templates are switched and should '''NOT''' be used for setting ''Date of Information'' .		'''Note''' that ''Last updated'' gets updated e.g. when templates are switched and should '''NOT''' be used for setting ''Date of Information'' .
	This '''[[Fieldreport ID and Dates \| page ]]]''' provides an overview of the fields in the table ''fieldreport''.		This '''[[Fieldreport ID and Dates \| page ]]''' provides an overview of the fields in the table ''fieldreport''.

	===Missing Local ID (DEF, items, Auxiliary data and Task)(mandatory)===__NOEDITSECTION__		===Missing Local ID (DEF, items, Auxiliary data and Task)(mandatory)===__NOEDITSECTION__
	In some database also Form ID and the items' local ID have been missing. If Form ID is null then the [[Empty Reconciliation Tab#Case 2 The tab is highlighted and no error message in the log \| '''Reconciliation tab will be empty''']] and it is not possible to see which ''Action'' was used. The [[Missing Local ID\|queries]] also include Auxiliary data and Task.		In some database also Form ID and the items' local ID have been missing. If Form ID is null then the [[Empty Reconciliation Tab#Case 2 The tab is highlighted and no error message in the log \| '''Reconciliation tab will be empty''']] and it is not possible to see which ''Action'' was used. The [[Missing Local ID\|queries]] also include Auxiliary data and Task.

	This '''[[Fieldreport ID and Dates \| page ]]]''' provides an overview of the fields in the table ''fieldreport''.		This '''[[Fieldreport ID and Dates \| page ]]''' provides an overview of the fields in the table ''fieldreport''.

	===Data Entry Form Templates===__NOEDITSECTION__		===Data Entry Form Templates===__NOEDITSECTION__

Alnaucler at 21:26, 12 November 2016

2016-11-12T21:26:55Z

← Older revision		Revision as of 23:26, 12 November 2016
Line 73:		Line 73:
	Due to changed behaviour of migration/import scripts in version 5.08.02 and a bug in 5.08.04 approval information may be missing. Note that ''Last updated'' gets updated e.g. when templates are switched and should not be used for setting Approved Date. If the Data Entry Form that misses Approved Date is an Activity or Education then you might be able to use End date [[Missing approval information\|(query)]].		Due to changed behaviour of migration/import scripts in version 5.08.02 and a bug in 5.08.04 approval information may be missing. Note that ''Last updated'' gets updated e.g. when templates are switched and should not be used for setting Approved Date. If the Data Entry Form that misses Approved Date is an Activity or Education then you might be able to use End date [[Missing approval information\|(query)]].

	{\| ~~class="wikitable"~~		This '''[[Fieldreport ID and Dates \| page ]]]''' provides an overview of the fields in the table ''fieldreport''.
	\|-
	~~! Column !! Old label !! New label~~
	\|-
	~~\| reportReceivedDate\|\| Initiated \|\| Data Entry Date~~
	\|-
	~~\| reportCompletedDate\|\| Submitted \|\| Submitted Date~~
	\|-
	~~\| reportVerifiedDate\|\| Approved \|\| Approved Date~~
	\|-
	~~\| dateofreport\|\| Date of Report \|\| Date~~ of ~~Information~~
	\|-
	~~\| dataentrydate\|\| Last updated \|\| (no change)~~
	\|-
	\|}

	===Missing Date of Information (mandatory)===__NOEDITSECTION__		===Missing Date of Information (mandatory)===__NOEDITSECTION__
Line 97:		Line 83:

	'''Note''' that ''Last updated'' gets updated e.g. when templates are switched and should '''NOT''' be used for setting ''Date of Information'' .		'''Note''' that ''Last updated'' gets updated e.g. when templates are switched and should '''NOT''' be used for setting ''Date of Information'' .
			This '''[[Fieldreport ID and Dates \| page ]]]''' provides an overview of the fields in the table ''fieldreport''.

	===Missing Local ID (mandatory)===__NOEDITSECTION__		===Missing Local ID (DEF, items, Auxiliary data and Task)(mandatory)===__NOEDITSECTION__
	In some database also Form ID and the items' local ID have been missing. If Form ID is null then the [[Empty Reconciliation Tab#Case 2 The tab is highlighted and no error message in the log \| '''Reconciliation tab will be empty''']] and it is not possible to see which ''Action'' was used. The [[Missing Local ID\|queries]] also include Auxiliary data and Task.		In some database also Form ID and the items' local ID have been missing. If Form ID is null then the [[Empty Reconciliation Tab#Case 2 The tab is highlighted and no error message in the log \| '''Reconciliation tab will be empty''']] and it is not possible to see which ''Action'' was used. The [[Missing Local ID\|queries]] also include Auxiliary data and Task.

			This '''[[Fieldreport ID and Dates \| page ]]]''' provides an overview of the fields in the table ''fieldreport''.

	===Data Entry Form Templates===__NOEDITSECTION__		===Data Entry Form Templates===__NOEDITSECTION__

Alnaucler at 22:50, 11 November 2016

2016-11-11T22:50:19Z

← Older revision		Revision as of 00:50, 12 November 2016
Line 99:		Line 99:

	===Missing Local ID (mandatory)===__NOEDITSECTION__		===Missing Local ID (mandatory)===__NOEDITSECTION__
	In some database also Form ID and the items' local ID have been missing. ~~The [[Missing Local~~ ID~~\|queries]] do not include Country structure, Organisation, Place, Task and WorkItem.~~		In some database also Form ID and the items' local ID have been missing. If Form ID is null then the [[Empty Reconciliation Tab#Case 2 The tab is highlighted and no error message in the log \| '''Reconciliation tab will be empty''']] and it is not possible to see which ''Action'' was used. The [[Missing Local ID\|queries]] also include Auxiliary data and Task.
	~~If this~~ is ~~not corrected~~ then the [[Empty Reconciliation Tab#Case 2 The tab is highlighted and no error message in the log \| '''Reconciliation tab will be empty''']] and it is not possible to see which ''Action'' was used.

	===Data Entry Form Templates===__NOEDITSECTION__		===Data Entry Form Templates===__NOEDITSECTION__

Alnaucler at 06:15, 11 November 2016

2016-11-11T06:15:10Z

← Older revision		Revision as of 08:15, 11 November 2016
Line 90:		Line 90:

	===Missing Date of Information (mandatory)===__NOEDITSECTION__		===Missing Date of Information (mandatory)===__NOEDITSECTION__
			[[Image:Missing date info3.png\|800px\|center]]
			<div align="center">
			'' Example showing the importance of Date of Information''
			</div>
	''Date of Information'' (stored in table ''fieldreport'') is used when {{IMSMANG}} calculates the Summary (former Current view) item/window. If this data is missing then the result may not be as the expected when the Summary item is updated. This field also is base for which DEF is possible to Unapprove in updating chain. On this page you find '''[[Missing Date of Information\|MySQL queries]]''' for checking if you need to populate this date. I have also added a query for checking if any ''Date of Information'' is in the '''future''' e.g. year 2024.		''Date of Information'' (stored in table ''fieldreport'') is used when {{IMSMANG}} calculates the Summary (former Current view) item/window. If this data is missing then the result may not be as the expected when the Summary item is updated. This field also is base for which DEF is possible to Unapprove in updating chain. On this page you find '''[[Missing Date of Information\|MySQL queries]]''' for checking if you need to populate this date. I have also added a query for checking if any ''Date of Information'' is in the '''future''' e.g. year 2024.

Alnaucler at 13:17, 10 November 2016

2016-11-10T13:17:47Z

← Older revision		Revision as of 15:17, 10 November 2016
Line 90:		Line 90:

	===Missing Date of Information (mandatory)===__NOEDITSECTION__		===Missing Date of Information (mandatory)===__NOEDITSECTION__
	Date of Information (stored in table ''fieldreport'') is used when {{IMSMANG}} calculates the Summary (former Current view). If this data is missing then the result may not be as the expected when the Summary is updated. ~~Note that ''Last updated'' gets updated e~~.~~g. when templates are switched and should '~~''~~NOT~~'~~'' be used for setting Date of Information~~ [[Missing Date of Information\|~~(query)~~]]. I have also added a query for checking if any Date of Information is in the future e.g. year 2024.		''Date of Information'' (stored in table ''fieldreport'') is used when {{IMSMANG}} calculates the Summary (former Current view) item/window. If this data is missing then the result may not be as the expected when the Summary item is updated. This field also is base for which DEF is possible to Unapprove in updating chain. On this page you find '''[[Missing Date of Information\|MySQL queries]]''' for checking if you need to populate this date. I have also added a query for checking if any ''Date of Information'' is in the '''future''' e.g. year 2024.

			'''Note''' that ''Last updated'' gets updated e.g. when templates are switched and should '''NOT''' be used for setting ''Date of Information'' .

	===Missing Local ID (mandatory)===__NOEDITSECTION__		===Missing Local ID (mandatory)===__NOEDITSECTION__

Alnaucler at 14:44, 26 October 2016

2016-10-26T14:44:17Z

← Older revision		Revision as of 16:44, 26 October 2016
Line 94:		Line 94:
	===Missing Local ID (mandatory)===__NOEDITSECTION__		===Missing Local ID (mandatory)===__NOEDITSECTION__
	In some database also Form ID and the items' local ID have been missing. The [[Missing Local ID\|queries]] do not include Country structure, Organisation, Place, Task and WorkItem.		In some database also Form ID and the items' local ID have been missing. The [[Missing Local ID\|queries]] do not include Country structure, Organisation, Place, Task and WorkItem.
			If this is not corrected then the [[Empty Reconciliation Tab#Case 2 The tab is highlighted and no error message in the log \| '''Reconciliation tab will be empty''']] and it is not possible to see which ''Action'' was used.

	===Data Entry Form Templates===__NOEDITSECTION__		===Data Entry Form Templates===__NOEDITSECTION__

Alnaucler at 18:34, 13 July 2016

2016-07-13T18:34:46Z

← Older revision		Revision as of 20:34, 13 July 2016
Line 27:		Line 27:
	\| MGRS\|\|MGRS\|\|MGRS\|\|<nowiki> 18NXL0251208301\|en\|GB\|</nowiki>		\| MGRS\|\|MGRS\|\|MGRS\|\|<nowiki> 18NXL0251208301\|en\|GB\|</nowiki>
	\|-		\|-
	\| MGRS\|\|MGRS\|\|Bearing and ~~distance~~\|\|<nowiki> 18NXL0251208301\|en\|GB\|</nowiki>		\| MGRS\|\|MGRS\|\|Bearing and Distance\|\|<nowiki> 18NXL0251208301\|en\|GB\|</nowiki>
	\|-		\|-
	\| UTM\|\|X/Y\|\|X and Y\|\|<nowiki> 508301\|602512\|en\|GB\|</nowiki>		\| UTM\|\|X/Y\|\|X and Y\|\|<nowiki> 508301\|602512\|en\|GB\|</nowiki>
	\|-		\|-
	\| UTM\|\|X/Y\|\|Bearing and ~~distance~~\|\|<nowiki> 508301\|602512\|en\|GB\|</nowiki>		\| UTM\|\|X/Y\|\|Bearing and Distance\|\|<nowiki> 508301\|602512\|en\|GB\|</nowiki>
	\|-		\|-
	\| WGS 1984\|\|Decimal Degrees\|\|X and Y\|\|<nowiki> -74.07584\|4.59806\|en\|GB\|</nowiki>		\| WGS 1984\|\|Decimal Degrees\|\|X and Y\|\|<nowiki> -74.07584\|4.59806\|en\|GB\|</nowiki>
	\|-		\|-
	\| WGS 1984\|\|Decimal Degrees\|\|Bearing and ~~distance~~\|\|<nowiki> -74.07584\|4.59806\|en\|GB\|</nowiki>		\| WGS 1984\|\|Decimal Degrees\|\|Bearing and Distance\|\|<nowiki> -74.07584\|4.59806\|en\|GB\|</nowiki>
	\|-		\|-
	\| WGS 1984\|\|Degrees:Decimal Minutes\|\|X and Y\|\|<nowiki> -74:04.55040\|004:35.88360\|en\|GB\|</nowiki>		\| WGS 1984\|\|Degrees:Decimal Minutes\|\|X and Y\|\|<nowiki> -74:04.55040\|004:35.88360\|en\|GB\|</nowiki>
	\|-		\|-
	\| WGS 1984\|\|Degrees:Decimal Minutes\|\|Bearing and ~~distance~~\|\|<nowiki> -74:04.55040\|004:35.88360\|en\|GB\|</nowiki>		\| WGS 1984\|\|Degrees:Decimal Minutes\|\|Bearing and Distance\|\|<nowiki> -74:04.55040\|004:35.88360\|en\|GB\|</nowiki>
	\|-		\|-
	\| WGS 1984\|\|Degrees:Minutes:Seconds\|\|X and Y\|\|<nowiki> -74:4:33.0234\|4:35:53.016\|en\|GB\|</nowiki>		\| WGS 1984\|\|Degrees:Minutes:Seconds\|\|X and Y\|\|<nowiki> -74:4:33.0234\|4:35:53.016\|en\|GB\|</nowiki>
	\|-		\|-
	\| WGS 1984\|\|Degrees:Minutes:Seconds\|\|Bearing and ~~distance~~\|\|<nowiki>-74:4:33.0234\|4:35:53.016\|en\|GB\|</nowiki>		\| WGS 1984\|\|Degrees:Minutes:Seconds\|\|Bearing and Distance\|\|<nowiki>-74:4:33.0234\|4:35:53.016\|en\|GB\|</nowiki>
	\|}		\|}
	{{Note \|		{{Note \|

Alnaucler at 07:14, 19 October 2015

2015-10-19T07:14:17Z

← Older revision		Revision as of 09:14, 19 October 2015
Line 177:		Line 177:

	===Multi-select CDFs (mandatory)===__NOEDITSECTION__		===Multi-select CDFs (mandatory)===__NOEDITSECTION__
	There is a display issue with imported/migrated Multi-select CDFs in data entry templates. Manually entered data or xml imported data is not affected. Novetta has verified that there is a bug in the code in both 5.08.04 and 6.0 (ICR-114) ~~but it will take time until this is fixed so wee~~ need to ~~add an extra step to all import/migration scripts~~. [[Multi-select CDFs \| (query)]].		There is a display issue with imported/migrated Multi-select CDFs in data entry templates. Manually entered data or xml imported data is not affected. Novetta has verified that there was a bug in the code in both 5.08.04 and early 6.0 (ICR-114). Therefore you need to verify if your country has any affected data. [[Multi-select CDFs \| (query)]].

	===CDF never used for Data Entry===__NOEDITSECTION__		===CDF never used for Data Entry===__NOEDITSECTION__

Alnaucler at 11:51, 3 July 2015

2015-07-03T11:51:57Z

← Older revision		Revision as of 13:51, 3 July 2015
Line 169:		Line 169:
	===Duplicate CDFs (mandatory)===__NOEDITSECTION__		===Duplicate CDFs (mandatory)===__NOEDITSECTION__
	In 5.08.04 it was allowed that CDFs had the same name and same parent if they had different data type. But there are countries that have duplicates anyhow.		In 5.08.04 it was allowed that CDFs had the same name and same parent if they had different data type. But there are countries that have duplicates anyhow.
	In version 6.0 there are '''three''' set of rules:		In version 6.0 there are '''[[Name Rules Staging Area \| three]]''' set of rules:
	* {{IMSMANG}}		* {{IMSMANG}}
	* Staging area		* Staging area