Changes

Jump to: navigation, search

Standardising Data Analysis and Information Reporting

1,807 bytes added, 13:44, 4 May 2021
no edit summary
{{TOC right}}
__NOEDITSECTION__The primary purpose Two of most important purposes of any an information system must be to are:* ensure high quality of data and* support operational use of the information .One important use of the data is reporting. If it collectsnot possible in an easy way to create reports/statistics which reflect the data correctly the credibility of the data is lost. That’s why {{IMSMANG }} was designed with a robust reporting and analysis component that supports various reporting options. These options include:
Table 15. <center>{| class="wikitable" width="1000"|-| align="center" colspan="6" | '''Comparison of {{IMSMANG }} Reporting Options'''|-| width="20pt" | | width="195pt" | '''Basic''' | width="195pt" | '''iReport'''| width="195pt" | '''Data export'''| width="195pt" | '''Other external reporting tool'''|-| align="left" | '''Description''' | align="left" | Includes printing Data Entry Forms, Summary items and maps| align="left" | Includes building iReport templates for more sophisticated reporting as well as exporting data for use in external tools such as Microsoft Excel| align="left" | Includes exporting data to CSV format for use in Excel as well as cutting and pasting from tables.| align="left" | The most complicated kind of reporting where users connect to backend databases using SQL, Crystal Reports, ArcGIS Desktop, etc., to perform queries and generate reports|-| align="left" | '''Uses''' | align="left" | *Navigating data in {{IMSMANG}}*General summaries of pre-provided data| align="left" | *Lists and summary reports of single items*Simple cross tabs*Monthly progress reports for internal consumption*Charts| align="left" | *Manipulating data using external tools*Pivot tables and charts based on one item| align="left" | *Linking or exporting {{IMSMANG}} data for use in external tools*Building customised reporting tools for {{IMSMANG}} data*Linking data to ArcGIS Desktop, Crystal Reports and other tools|-| align="left" | '''Benefits''' | align="left" | *Fast and easy to use*Requires little or no training| align="left" | *Can limit data using searches*Can be preformatted and available on a network*Backed up and stored*Users can simply run these reports as opposed to building them*Supports charts| align="left" | *Easiest way to get {{IMSMANG}} data into Excel*Can manipulate data in common applications| align="left" | *Most powerful and customisable way of accessing data for reports*Can manipulate data in advanced or custom reporting applications*Can be linked with external databases|-| align="left" | '''Challenges''' | align="left" | *Reports are simplistic*Limited to printing and reports provided with the software. No customisation.| align="left" | *Not ideal for incorporating multiple reports together within a larger report| align="left" | *Limited customisation of resulting data (formats, conditional display, etc.)*Not ideal for incorporating multiple reports together within a larger report| align="left" | *Requires expert level understanding of SQL|}</center>[[Image:BI in context graph.png|center|700px']]
Basic iReport Data export External reporting tools
Description Includes printing field reports, current views and maps Includes building iReport templates for more sophisticated reporting as well as exporting data for use in external tools such as Microsoft Excel
Includes exporting data to CSV format for use in Excel as well as cutting and pasting from tables. The most complicated kind of reporting where users connect to backend databases using SQL, Crystal Reports, ArcGIS Desktop, etc., to perform queries and generate reports
Uses==Basic Reporting==__NOEDITSECTION__{{IMSMANG}} provides several reporting options that allow users to produce basic reports directly from {{IMSMANG}}. These include printing Data Entry Forms entered into the system, maps from the main navigation window and Summary items. Any of these reports can be sent directly to a printer or to an intermediate format such as rich text format (.RTF) or portable document format (.PDF) for transmitting in electronic format or for further editing.
 Navigating data in {{IMSMANG General summaries of pre}} also includes a Map Layout manager that allows users to define map layouts and print high-provided quality maps with {{IMSMANG}} data Lists and summary reports of single items Simple cross tabs Monthly progress reports for internal consumption Any report where the data is more important than the formatting  Manipulating data using external tools Pivot tables . Information managers can define map layout templates that include scale bars, annotations and charts based on one item  Linking legends or exporting IMSMANG data for use in external tools Building customised reporting more sophisticated tools like ArcGIS Desktop to prepare more complicated map layouts for displaying {{IMSMANG }} data Linking data to ArcGIS Desktop, Crystal Reports and other tools.
[[Image:AdminGuide_ExampleMapLayoutTemplate.png|center|500px|''Example of a Map Layout Template'']]
<div align="center">
''Example of a Map Layout Template''
</div>
Benefits  Fast and easy to use{{note| Requires little or no training   Can limit data using searches Can * Map layouts can be preformatted printed and available on a network Backed up and stored Users can simply run these reports as opposed to building them Supports charts  Easiest way to get IMSMANG data into Excel Can manipulate data in common applications  Most powerful and customisable way of accessing data for reports Can manipulate data in advanced or custom reporting applications Can be linked with external databasesChallenges  Reports are simplistic Limited scaled to printing and reports provided with the softwareany size paper. No customisation.  Limited customisation of resulting data (formats, conditional display, etc.) Not ideal for incorporating multiple reports together within This is a larger report  Only works with one item at a time Process is conducted outside simple way of producing {{IMSMANG and so not controlled  Requires expert level understanding of SQL  ==Basic Reporting==IMSMANG provides several reporting options that allow users to produce basic reports directly from IMSMANG. These include printing field reports entered into the system, }} maps from the main navigation window and item current views for summaries of itemswithout needing additional GIS software. Any of these reports * Map layout templates can be sent directly to a printer or prepared and distributed to an intermediate format such as rich text format (.RTF) or portable document format (.PDF) for transmitting in electronic format or for further editing. individual {{IMSMANG also includes a Map Layout manager that allows users }} clients, allowing information managers to define map layouts and print high-quality maps with IMSMANG data. Information managers can define map layout prepare templates that include scale bars, annotations and legends based on user preferences or use more sophisticated tools like ArcGIS Desktop to prepare more complicated map layouts for displaying IMSMANG datafunctional needs.}}
==Embedded Reporting==__NOEDITSECTION__Figure 25{{IMSMANG}} supplements the basic reporting options available to all users with several more sophisticated reporting tools that are embedded within the system. Example In addition to reporting on individual elements, these embedded tools allow for statistical and aggregate reporting of data within the database. Instead of reporting the contents of a Map Layout Templatesingle report, statistical reporting allows information managers to produce reports about multiple items and to use functions such as sum, average and count to summarise data.
There are two options for embedded reporting: iReports and data export. Both functions rely on {{note|* Map layouts IMSMANG}} searches to filter data. Using iReports, information managers can be printed and scaled build reporting templates to any size paper. This is visualise data in a simple way of producing IMSMANG maps without needing additional GIS softwarespecific and repeatable format.* Map layout templates can be prepared and distributed to individual IMSMANG clientsUsing data export, allowing information managers can export search results to prepare templates based on user preference or functional need}} an external tool such as Microsoft Excel and perform aggregation and statistical analysis.
===iReports===__NOEDITSECTION__
{{HowTo's
|[[HowTo: Print Maps Use iReport | Print Maps]]|[[HowTo: Print Maps and Data | Print Maps and DataUse iReport]]
}}
 ==Embedded Reporting==IMSMANG supplements the basic reporting options available to all users with several more sophisticated reporting tools that are embedded within the system. In addition to reporting on individual elements, these embedded tools allow for statistical and aggregate reporting of data within the database. Instead of reporting the contents of a single report, statistical reporting allows information managers to produce reports about multiple items and to use functions such as sum, average and count to summarize data.  There are two options for embedded reporting: iReports and data export. Both functions rely on IMSMANG searches to filter data. Using iReports, information managers can build reporting templates to visualize data in a specific and repeatable format. Using data export, managers can export search results to an external tool such as Microsoft Excel and perform aggregation and statistical analysis. ===iReports=== With the iReport tool, information managers have access to an entire suite of report generation functions. iReport provides the ability to design report templates from the desired data elements; add page layout and formatting information including images, colours and text; and import the reports into {{IMSMANG }} for data entry personnel to run. Information managers can also design complex reports to summarize summarise data using sum, count, average, subreports and other statistical reporting functions similar to packages such as Crystal Reports. Being fully integrated into {{IMSMANG}}, iReport can be translated into any language supported by the system. Using this approach, only information managers are presented with the complexity of designing reports while traditional users simply have to select a report (and any preceding search) and run it.
Typical uses for iReport include producing reports commonly required by multiple users within a programme. These reports can include:
*clearance: monthly progress reporting MRE*education: number of people trained by type of training hazard*land: sum of hazardous area by province or type of hazardland*accidents: number of accidents by type or by province*data quality: number and list of hazards land with incorrect status
Because iReport templates are initiated with a search, they provide a scalable reporting solution that allows one template to be developed for many reports. For example, a report template that shows number a list of hazards and size of hazards by province land with associated ordnance details can produce different reports depending on the search parameters.  Figure 26. Report Example Using No Search ParametersIn the first example, no search parameter is applied and all data in IMSMANG is used in the report. But by adding a search parameter, for example, limiting this to hazards whose status is active, a different report is generated.
[[Image:AdminGuide_ReportUsingNoSearchParameters.png|center|500px|''Report Example Using No Search Parameters'']]Figure 27. <div align="center">''Report Example Using a No Search ParameterParameters''Moreover, if the hazards are further limited to hazards that are minefields (excluding UXO and battle areas), another report is generated, all using the same template. In this way, information managers can build templates and searches to fulfil multiple reporting needs.</div>
Reports created with iReport can be printed directly within In the first example, no search parameter is applied and all data in {{IMSMANG or saved to an intermediate format such as }} is used in the report.RTFBut by adding a search parameter, .PDF or .XLS for electronic transmission or additional editing or inclusion in other reports. iReport supports the inclusion of chartsexample, images and headers and footerslimiting this to land whose status is Worked on, and it acts as a complete reporting package similar to Crystal Reportsdifferent report is generated.
{{HowTo's|[[HowToImage: Use i-Report AdminGuide_ReportUsingSearchParameters.png|center|500px| Use i-''ReportExample Using a Search Parameter'']]}}<div align="center">===Data Export===''Report Example Using a Search Parameter''</div>
IMSMANG also provides data export functionality designed Moreover, if the land is further limited to allow users to export data to external tools such as Microsoft Excel for additional reporting and analysis. This lets users take advantage of functionality in these tools such as sums, countsa specific type, chartsanother report is generated, pivot tables and other data manipulation functions to format and present data. Users access this functionality by performing a search in IMSMANG and then exporting using again the results to same template.CSV format. Users This way, information managers can choose which columns build templates and searches to export, and the data can be manipulated in any external tool that supports .CSVfulfill multiple reporting needs.
Because data export is initiated Reports created with a search, it provides a flexible approach for getting data iReport can be printed directly within {{IMSMANG}} or saved to an external toolintermediate format such as . HoweverRTF, once .PDF or .XLS for electronic transmission or additional editing or inclusion in other reports. iReport supports the data is used in a tool outside inclusion of IMSMANGcharts, images and headers and footers, and it is impossible to control how this data is manipulated which may limit the consistency of reports produced in this way.  {{note|IMSMANG searches return information on only one item at acts as a time, and data export is limited to the data returned by the searchcomplete reporting package. Data from linked items (such as victim data linked to accidents) is not available for export}}
===Data Export===__NOEDITSECTION__
{{HowTo's
|[[HowTo: Export data Exporting| Export data]]
}}
==External Reporting Tools=={{IMSMANG }} also allows information managers provides data export functionality designed to connect advanced allow users to export data to external tools such as Microsoft Excel for additional reporting and analysis. This lets users take advantage of functionality in these tools such as Crystal Reports or ArcGIS Desktop directly sums, counts, charts, pivot tables and other data manipulation functions to its relational database for highly advanced report generationformat and present data. With Users access this capability, information managers can use custom reporting solutions functionality by performing a search in {{IMSMANG}} and then exporting the results to connect with IMSMANG, allowing for complete control of IMSMANG outputs. Or, managers CSV format. Users can modify existing reporting solutions choose which columns to connect to IMSMANGexport, which leverages technology already implemented in the programme and limits the need for retrainingdata can be manipulated in any external tool that supports .CSV.
{{note|Using external reporting tools Because data export is initiated with a complex activity requiring search, it provides a flexible approach for getting data to an advanced understanding of SQLexternal tool. However, reporting tools and once the data is used in a tool outside of {{IMSMANG data model}}, it is impossible to control how this data is manipulated which may limit the consistency of reports produced in this way.
===Connecting External Reporting Tools===The process for connecting external reporting tools {{note|{{IMSMANG}} searches return information on only one item at a time, and data export is essentially the same for all tools. External tools connect limited to the IMSMANG relational database via an ODBC connection. Information managers establish this connection data returned by installing the ODBC driver for MySQLsearch. When this Data from linked items (such as victim data linked to accidents) is complete, information managers can connect any ODBC-compliant tool to the IMSMANG database, including reporting tools, other database packages and SQL management toolsnot available for export. Examples include:}}
==External Reporting Tools==__NOEDITSECTION__{{IMSMANG}} also allows information managers to connect advanced reporting tools Database packages and SQL management tools* such as Crystal Reports* or ArcGIS Desktop* iReport* Microsoft Excel * Microsoft Access* OpenOffice Base* Microsoft SQL Server* Oracle* MySQL Query Browser* Navicat* TOAD SQL* Heidi SQLdirectly to its relational database for highly advanced report generation. With this capability, information managers can use custom reporting solutions to connect with {{IMSMANG}}, allowing for complete control of {{IMSMANG}} outputs. Or, managers can modify existing reporting solutions to connect to {{IMSMANG}}, which leverages technology already implemented in the programme and limits the need for retraining.
{{note|When connecting an using external reporting tool tools we recommend to IMSMANG, it is recommended that information managers build database views within the database to do any necessary data transformations. While it is possible connect to directly import or connect IMSMANG database tables in external tools and perform transformations within the external tools, the recommended method is to do transformations within '''[[IMSMA Staging Area | Staging area]]''' instead of the {{IMSMANG }} database using database views and then import . It does require knowledge about the resulting views into the external toolsIMSMA data model. Contact contact your [[Information Management Team | GICHD IM advisor]] if you have questions.}}
===Connecting other External Reporting Tools===__NOEDITSECTION__The process for connecting external reporting tools is essentially the same for all tools. External tools connect to the {{note|Building IMSMANG}} relational database views via an ODBC connection. Information managers establish this connection by installing the ODBC driver for PGSQL. When this is complete, information managers can connect any ODBC-compliant tool to transform data before importing it into other tools significantly reduces the performance hit associated with connecting external tools{{IMSMANG}}database, including reporting tools, other database packages and SQL management tools. Examples include:
{| class="wikitable"! scope="col" | Reporting tools || scope=Building "col" | Database Views==packages || scope=Building database views is the primary way of transforming data to support external reporting. Information managers can use "col" | SQL editing management tools to build and save database queries as views that can be used to format data for easier reporting. Using database views, information managers can join data together into flat tables that allow for easier incorporation into reports or other analysis tools. Database views act like database tables and can be imported or queried from external tools. Moreover, views automatically refresh as data is added to IMSMANG and provide an up|-| Crystal Reports || Microsoft Access || PGSQL Query Browser|-| ArcGIS Desktop || OpenOffice Base || Navicat|-to| iReport || Microsoft SQL Server || TOAD SQL|-date data source for other applications.| Microsoft Excel || Oracle || Heidi SQL|}
Using database viewsWhen connecting an external reporting tool to {{IMSMANG}}, it is recommended that information managers can perform statistical and other operations on build database views within the IMSMANG set for reporting purposes including sum, count and average or more complicated functions available in SQL. These operations can be combined with search criteria database to provide a highly precise mechanism for providing do any necessary data transformations. While it is possible to reports. For exampledirectly import or connect {{IMSMANG}} database tables in external tools and perform transformations within the external tools, information managers can create a view that returns the name of each clearance recommended method is to do transformations within the {{IMSMANG}} database using database views and a sum of then import the resulting views into the hours worked, AP mines found and area cleared on all progress reports linked to each clearanceexternal tools.
{{note|Building database views to transform data before importing it into other tools significantly reduces the performance hit associated with connecting external tools.}}
===Building Database Views===__NOEDITSECTION__
Building database views is the primary way of transforming data to support external reporting. Information managers can use SQL editing tools to build and save database queries as views that can be used to format data for easier reporting. Using database views, information managers can join data together into flat tables that allow for easier incorporation into reports or other analysis tools. Database views act like database tables and can be imported or queried from external tools. Moreover, views automatically refresh as data is added to {{IMSMANG}} and provide an up-to-date data source for other applications.
Clearance ID Area cleared Using database views, information managers can perform statistical and other operations on the {{IMSMANG}} set for reporting purposes including sum, count and average or more complicated functions available in SQL. These operations can be combined with search criteria to provide a highly precise mechanism for providing data to reports. For example, information managers can create a view that returns the name of each clearance and a sum of the hours worked, AP mines found Hours worked Number of and area cleared on all progress reportsCL-1022 23,400 45 120 4CL-1239 22,330 42 160 6CL-2345 1,920 4 20 1linked to each clearance.
<center>{| class="wikitable" width="600"|-| align="left" | '''Clearance ID'''| align="left" | '''Area cleared'''| align="left" | '''AP mines found'''| align="left" | '''Hours worked'''| align="left" | '''Number of progress reports'''|-| align="left" | CL-1022| align="left" | 23,400| align="left" | 45| align="left" | 120| align="left" | 4|-| align="left" | CL-1239 | align="left" | 22,330 | align="left" | 42 | align="left" | 160 | align="left" | 6|-| align="left" | CL-2345| align="left" | 1,920| align="left" | 4| align="left" | 20| align="left" | 1|}</center> This view could then be pasted into Excel, linked with additional {{IMSMANG }} data or external data or linked with a map to provide additional analysis. As such, database views provide a powerful way of formatting and analysing {{IMSMANG }} data.
{{note|
* Database views created in {{IMSMANG }} are backed up by the {{IMSMANG }} backup functionality. However, it is important to correctly set the database permissions on views or it will cause problems when restoring the databases.* Information managers should maintain separate files containing the view creation scripts so that they can be quickly and easily restored or modified. Using the CREATE OR UPDATE REPLACE VIEW syntax from SQL is an easy way to build scripts for creating or updating replacing views if they already exist.}}
{{NavBox IMSMA NG Administration}}
{{HowTo's}}[[Category:NAA]]
6,632
edits

Navigation menu