AppDynamics Monitoring Extension for use with MongoDB

By:
balakrishna.v, akshay.srivastava , Version: 2.0.0
AppDynamics supported
Updated Oct. 12, 2020, 10:36 p.m.

Use Case

The MongoDB custom monitor captures statistics from the MongoDB server and displays them in the AppDynamics Metric Browser.

This extension works only with the standalone machine agent.

Pre-requisite

Before the extension is installed, the prerequisites mentioned here need to be met. Please do not proceed with the extension installation if the specified prerequisites are not met.

Installation

Download and unzip MongoMonitor.zip into <MACHINE_AGENT_HOME>/monitors/
Edit the file config.yml located at <MachineAgent_Dir>/monitors/ The metricPrefix of the extension has to be configured as specified here. Please make sure that the right metricPrefix is chosen based on your machine agent deployment, otherwise this could lead to metrics not being visible in the controller.
Restart the machineagent
In the AppDynamics Metric Browser, look for: Application Infrastructure Performance | <Tier> | Custom Metrics | Mongo Server.

Configuration

Note : Please make sure to not use tab (\t) while editing yaml files. You may want to validate the yaml file using a yaml validator

Configure the Mongo instances by editing the config.yml file in <MACHINE_AGENT_HOME>/monitors/MongoMonitor/.

For eg.

    # MongoDB host and port. If ReplicaSet is enabled, configure all OR subset of members of the cluster.
    servers:
      - host: "localhost"
        port: 27017
      - host: "localhost"
        port: 27018

    # Specify this key if Password Encryption Support is required else keep it empty
    # If specified, adminDBPassword and databases passwords are now the encrypted passwords.
    passwordEncryptionKey: ""

    # Admin DB username and password. Required if mongod is started with --auth (Authentication) else keep empty
    # The user should have clusterMonitor role as a minimum
    adminDBUsername: "admin"
    adminDBPassword: "admin"

    # Change ssl to true if mongod is started with ssl. T
    ssl: false

    #prefix used to show up metrics in AppDynamics
    metricPathPrefix:  "Custom Metrics|Mongo Server|"
    #This will create it in specific Tier. Replace 
    #metricPathPrefix:  "Server|Component:|Custom Metrics|Mongo Server|"

Configure the path to the config.yml file by editing the in the monitor.xml file in the <MACHINE_AGENT_HOME>/monitors/MongoMonitor/ directory. Below is the sample

 <task-arguments>
     <!-- config file-->
     <argument name="config-file" is-required="true" default-value="monitors/MongoMonitor/config.yml" />
      ....
 </task-arguments>

Note : By default, a Machine agent or a AppServer agent can send a fixed number of metrics to the controller. To change this limit, please follow the instructions mentioned here. For eg.

    java -Dappdynamics.agent.maxMetrics=2500 -jar machineagent.jar

Metrics

Server Stats

Metric Name	Description
Up Time (ms)	The duration of time that the server is up

Metric Category: Asserts

Metric Name	Description
Message
Regular
Rollover
User
Warning

Metric Category: Background Flushing

Metric Name	Description
Flushes	Number of times the database has been flushed
Total (ms)	Total time (ms) that the mongod process spent writing data to disk
Average (ms)	Average time (ms) that the mongod process spent writing data to disk
Last (ms)	Time (ms) that the mongod process last spent writing data to disk

Metric Category: Connections

Metric Name	Description
Current	Number of current connections to the database server from clients. This number includes the current shell connection as well as any inter-node connections to support a replica set or sharded cluster.
Available	Number of unused available connections that the database can provide. Consider this value in combination with the value of Current to understand the connection load on the database.

Metric Category: Global Lock

Metric Name	Description
Total Time	The total time since the globalLock was started and created

Active Clients

Metric Name	Description
Total	Number of active client connections to the database
Readers	Number of readers performing read operations
Writers	Number of writers performing write operations

Current Queue

Metric Name	Description
Total	Number of operations queued before a lock
Readers	Number of operations waiting for the read-lock
Writers	Number of operations waiting for the write-lock

Metric Category: Index Counter

Metric Name	Description
Accesses
Hits
Misses
Resets

Metric Category: Memory

Metric Name	Description
Bits	Target Architecture
Resident	Amount of RAM (MB) currently used by the database process
Virtual	MB currently used by the mongod process
Mapped	Amount of mapped memory (MB) used by the database
Mapped With Journal	Amount of mapped memory (MB), including memory used for journaling.

Metric Category: Network

Metric Name	Description
Bytes In	The amount of network traffic (bytes) received by the database
Bytes Out	The amount of network traffic (bytes) sent from the database
Number Requests	Number of distinct requests that the server has received

Metric Category: Operations

Metric Name	Description
Insert	Number of insert operations
Query	Number of query operations
Update	Number of update operations
Delete	Number of delete operations
GetMore	Number of getmore operations
Command	Total number of commands issued to database

Replica Stats

For each replica the following metrics are reported.

Metric Name	Description
Up Time (ms)	The duration of time that the server is up
Health	Conveys if the member is up (i.e. 1) or down (i.e. 0.)
[State](http://docs.mongodb.org/manual/reference/replica-states/)	Value between 0 and 10 that represents the replica state of the member.

DB Stats

Metric Name	Description
avgObjSize	The average size of each document in bytes. This is the dataSize divided by the number of documents
collections	Contains a count of the number of collections in that database
dataSize	The total size in bytes of the data held in this database including the padding factor
fileSize	The total size in bytes of the data files that hold the database
indexes	Contains a count of the total number of indexes across all collections in the database
indexSize	The total size in bytes of all indexes created on this database
nsSizeMB	The total size of the namespace files (i.e. that end with .ns) for this database
numExtents	Contains a count of the number of extents in the database across all collections
objects	Contains a count of the number of objects (i.e. documents) in the database across all collections
storageSize	The total amount of space in bytes allocated to collections in this database for document storage

Metric Category: Collection Stats

Metric Name	Description
count	The number of objects or documents in this collection
lastExtentSize	The size of the last extent allocated
nindexes	The number of indexes on the collection
numExtents	The total number of contiguously allocated data file regions
paddingFactor	The amount of space added to the end of each document at insert time
size	The size of the data stored in this collection
storageSize	The total amount of storage allocated to this collection for document storage
systemFlags	Reports the flags on this collection that reflect internal server options
totalIndexSize	The total size of all indexes. The scale argument affects this value
userFlags	Reports the flags on this collection set by the user

Credentials Encryption

Please visit this page to get detailed instructions on password encryption. The steps in this document will guide you through the whole process.

Extensions Workbench

Workbench is an inbuilt feature provided with each extension in order to assist you to fine tune the extension setup before you actually deploy it on the controller. Please review the following document on How to use the Extensions WorkBench

Troubleshooting

Please look at the troubleshooting document and make sure that everything is followed correctly.

Support Tickets

If after going through the Troubleshooting Document you have not been able to get your extension working, please file a ticket and add the following information.

Please provide the following in order for us to assist you better.

1. Stop the running machine agent.
2. Delete all existing logs under <MachineAgent>/logs.
3. Please enable debug logging by editing the file                                <MachineAgent>/conf/logging/log4j.xml. Change the level value of the            following <logger> elements to debug.
    <logger name="com.singularity">
    <logger name="com.appdynamics">
4. Start the machine agent and please let it run for 10 mins. Then zip and        upload all the logs in the directory 
    <MachineAgent>/logs/*.
5. Attach the zipped <MachineAgent>/conf/* directory here.
6. Attach the zipped <MachineAgent>/monitors/ExtensionFolderYouAreHavingIssuesWith directory here.

For any support related questions, you can also contact help@appdynamics.com.

Contributing

Always feel free to fork and contribute any changes directly via GitHub.

Version

Extension Version:	2.0.0
MongoDB Tested on:	3.4
Controller Compatibility:	4.5+
MA Compatibility:	4.5.13+
Last Update:	05/29/2020

List of Changes changes to this extension can be found here

Attachments:

MongoMonitor-2.0.0.zip